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i  INTRODUCTION 


Control  of  multivariable  systems  traditionally  has  been  oriented  towards  meeting  require¬ 
ments  of  system  stability,  insensitivity  to  plant  variations,  rejection  of  disturbances,  steady 
state  accuracy,  and  transient  performance. 

Recently,  research  has  concentrated  on  the  disturbance-rejection  problem,  and  on  sensi¬ 
tivity  with  respect  to  large  plant  deviations.  The  disturbance-rejection  problem  hats  been 
formulated  as  a  worst-case  design  problem,  starting  from  the  classical  “game  against  na¬ 
ture”  work,  where  such  a  formulation  is  explicit,  through  the  more  recent  work  on  //qq- 
norm  optimization  formulation,  where  its  presence  is  implicit.  Alternatively,  minimization 
of  a  frequency- weighted  //00-norm  is  an  appropriate  problem  formulation  for  achieving  im¬ 
proved  robustness  of  system  performance  to  structured  and  unstructured  plant  variations. 
Frequency-domain-based  results  on  the  H optimal  and  suboptimal  solutions  have  led,  how¬ 
ever,  to  the  conclusion  that  the  required  controllers  are  of  order  higher  than  the  plant.  The 
recent  return  to  the  minimax  formulations  of  the  disturbance-rejection  problem  in  the  time 
domain  has  shown  that  /foo-norm  optimal  (and  suboptimal)  solutions  exist  in  the  form  of 
state-feedback  and  if  controls  are  restricted  to  output-feedback,  in  the  form  of  a  full-order 
(same  as  the  plant)  observer  with  modified  plant  matrix.  A  complete  set  of  the  necessary 
and  sufficient  conditions  for  //oo-norm  controllers  expressed  via  the  appropriate  Algebraic 
Riccati  Equations  (AREs)  appears  in  [1]  while  earlier  work  on  the  connection  between  the 
ARE  and  the  norm  optimization  problem  leading  to  these  results  can  be  found  in  [2]. 
The  recent  paper  [3],  reviews  the  roots  and  history  of  the  worst  case,  i.e.,  minmax,  approach 
to  disturbance  rejection.  These  results  have  shown  that  the  rich  theory  on  the  structure  and 
properties  of  the  solutions  to  the  ARE,  coupled  with  the  properties  of  the  related  Riccati 
operator  and  the  Riccati  inequality,  provide  extremely  useful  and  fruitful  tools  for  consider¬ 
ation  of  the  classical  problems  in  design  of  multivariable  systems  as  well  as  the  consideration 
of  important  new  problems. 

The  research  reported  herein  has  concentrated  on  the  development  of  design  methodolo¬ 
gies  to  meet  simultaneously  several  diverse  requirements  including  transient  performance, 
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disturbance  rejection,  robustness,  and  reliability,  using  the  following  classes  of  admissible 
controllers: 

•  low-order  controllers;  the  goal  here  is  to  satisfy  the  basic  performance,  disturbance- 
rejection,  and  robustness  requirements, 

•  full-order  output-feedback  controllers,  of  the  same  order  as  the  plant;  the  goal  here  is  to 
improve  the  reliability  of  the  system  by  designing  controllers  capable  of  withstanding 
outages  of  sensors  and  actuators,  without  loosing  stability  or  increasing  the  H0 0  norm 
bound; 

•  output-feedback  controllers  for  decentralized  systems;  the  goal  here  is  to  meet  require¬ 
ments  associated  with  transient  performance,  disturbance  rejection  and  reliability  using 
a  decentralized  control  structure. 

The  presentation  is  organized  with  respect  to  the  classes  of  admissible  controllers.  Sec¬ 
tion  2  and  3  deal  mainly  with  topics  related  to  design  of  low  order  controllers.  Sections  4, 
5,  and  6  deal  mainly  with  topics  related  to  state-feedback  and  full-order  output  feedback- 
controllers. 

The  design  methodologies  we  have  developed  are  based  on: 

•  Projective  controls,  which  provide  a  parametrized  family  of  low-order  controllers  that 
guarantee  certain  performances  specifications  are  met  and  possess  free  parameters  to 
be  used  to  meet  additional  requirements. 

•  The  Frobenius-Hankel  (FH)  norm  as  a  computationally  attractive  measure  of  opti¬ 
mality  to  meeting  disturbance  rejection  and  robustness  requirements  with  low-order 
projective  controllers. 

•  The  algebraic  Riccati  equation  based  characterization  of  i/oo-norm-bounding  con¬ 
trollers,  including 

-  state- feedback  controllers  to  provide  the  reference  solution  for  the  projective  con¬ 
trollers,  and 
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-  full-order  output-feedback  controllers  that  meet  robustness  and  reliability  require¬ 
ments,  or  solve  the  decentralized  control  problem. 

The  details  of  this  research  have  been  presented  in  the  references  listed  below  and  in 
manuscripts  now  in  preparation.  In  the  following  we  highlight  the  main  contributions. 

As  indicated,  projective  controls  represent  a  parametrized  class  of  low-order  controllers 
which  provide  the  means  for  a  systematic  two-phase  design  to  achieve  diverse  design  objec¬ 
tives.  In  [4]  a  methodology  was  developed  which  applied  projective  controls  to  disturbance 
attenuation  for  large  flexible  structures  and  other  systems  with  many  degrees  of  freedom. 
The  two-stage  design  first  identifies  and  parametrizes  all  strictly  proper  controllers  of  given 
order  that  retain  the  dominant  system  poles  (i.e.,  dynamics)  as  defined  by  state- feedback 
reference  dynamics,  and  then  selects  a  particular  controller  by  determining  the  free  controller 
parameters  to  minimize  a  measure  of  disturbance  attenuation.  The  measure  utilized  is  the 
FH  norm,  the  minimization  of  which  is  computationally  attractive  and  also  places  a  bound 
on  the  //oo-norm.  Restriction  of  the  controllers  to  the  class  of  projective  controllers  fixes  the 
system  poles  for  transient  behavior  and  disturbance  attenuation  while  FH-norm  minimiza¬ 
tion  then  positions  system  zeros  to  enhance  disturbance  attenuation  by  low-order  strictly 
proper  controllers. 

In  [5]  the  two-stage  design  procedure  was  extended  to  design  multiple  control  loops 
for  transient  performance  and  disturbance  attenuation  using  a  low-order  controller  in  each 
loop.  The  H0 o  optimal  state-feedback  solution  was  employed  to  specify  and  parametrize 
all  decentralized  projective  controllers  that  now  create  fixed  modes  at  desired  locations. 
Then,  using  the  FH-norm  minimization  approach,  the  free  parameters  in  all  controllers  were 
determined  to  place  the  zeroes  and  remaining  poles  to  augment  disturbance  attenuation. 

The  procedures  was  further  extended  in  [6]  to  design  decentralized  projective  controls  via 
the  //oo/FH-norm  minimization  procedure  for  the  case  when  the  controllers  are  restricted  to 
be  strictly  proper. 

In  [7]  the  FH-norm  approach  to  disturbance  rejection  was  applied  to  discrete-time  sys¬ 
tems.  A  new  computational  algorithm  to  minimize  the  FH  norm  for  controllers  of  bounded 
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order  was  developed  based  on  the  use  of  the  (discrete)  algebraic  Riccati  equations  which,  in 
the  limit,  reduce  to  the  Lyapunov  equations  that  characterize  the  necessary  conditions.  The 
success  of  the  algorithm  is  attributed  to  the  expanded  regions  of  existence  of  positive  definite 
solutions  to  the  Riccati  equations,  as  opposed  to  Liapunov  equations.  A  nontrivial  5th  order 
example  illustrates  not  only  the  convergence  rate  of  the  algorithm  but  also  the  nature  of 
the  reduction  of  the  FK  norm,  the  Hoo  norm,  the  Trace  norm  and  the  Hankel  norm  at  each 
iteration.  Also  illustrated  are  bounds  on  Hoo  norm  in  terms  of  the  values  of  the  FH  norm: 

-LllCWII™  <  IIGMIU  <  2y/n\\G(s)\\FH 

vn 

where  n  is  the  order  of  the  closed-loop  system.  In  [8]  the  above  approach  and  the  ARE-based 
computational  algorithm  were  extended  to  cover  in  a  unified  approach  three  general  classes 
of  design  problems:  disturbance  rejection,  tracking,  and  model  reference  design. 

The  recent  results  enabling  the  construction  of  i/oo-norm-bounding  controllers  via  the 
algebraic  Riccati  equation  has  stimulated  vigorous  research  into  designs,  to  which  we 
have  recently  made  a  number  of  contributions.  Our  research  has  encompassed  many  issues 
not  treated  previously  by  other  researchers.  These  include  the  development  of  better  bounds 
on  the  //or-norm  for  established  ARE-based  designs  [9],  and  the  study  of  the  properties  of 
the  convex  Riccati  operator 

R{X)  =  Ft  X  +  XF+  -4 XGGtX  +  HtH 

V 

and  the  associated  algebraic  Riccati  inequality  R(X)  <  0  [10].  These  properties  were  fun¬ 
damental  in  rederiving  in  simple  terms  the  state-feedback  and  output-feedback  //oo-norm- 
tounding  controllers  and  extending  the  procedure  to  achieve  robust  stabilization  with  an 
tfoo-norm  bound  in  the  presence  of  structured  uncertainty  [llj.  Also  a  new  parametrization 
of  all  state-feedback  controls  and  output-feedback  controls  that  that  guarartee  a  specified 
//oo-norm  bound  [12]  has  been  obtained. 

In  [13],  [14]  the  approach  was  extended  to  the  design  of  controllers  for  decentralized 
systems.  It  was  shown  that  a  controller  of  the  same  order  as  the  system  can  be  developed 
for  each  control  channel  by  constructing  for  each  channel  an  observer  in  which  the  controls 
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associated  with  other  channels  are  replaced  by  the  estimates  of  these  controls,  as  they  are 
defined  by  the  state-feedback  solution  to  the  //^-norm-bounding  problem,  and  the  distur¬ 
bance  is  replaced  by  the  worst  disturbance  as  described  by  the  same  state-feedback  solution. 
The  observer  gains  for  the  controllers  are  determined  by  the  positive  definite  solution  of  a 
large-dimensional  (n  x  r,  where  r  is  the  number  of  control  channels)  Riccati-like  algebraic 
equation. 

The  developed  design  methodology  was  extended  to  the  problem  of  design  of  reliable 
control  systems  [15].  This  includes  the  design  of  control  systems  that  possess  the  following 
properties: 

•  stable  controllers,  i.e.,  strongly  stable  closed-loop  system, 

•  robustness  to  the  loss  of  a  selected  subset  of  measurements,  and 

•  robustness  to  the  loss  of  a  selected  subset  of  control  inputs. 

The  essence  of  our  approach  stems  from  the  fact  that  if  X  >  0  satisfies  R(X)  -f  P  =  0, 
where  P  >  0,  then  //(A-)  <  0  and  consequently  stability  and  f/oo-norm  bound  can  be  guaran¬ 
teed  for  the  base  case,  while  by  judicious  choice  of  P  one  can  guarantee  additional  properties, 
such  as  those  mentioned  above.  In  [16]  the  approach  was  extended  to  decentralized  control 
structures,  and  decentralized  full  order  controllers  reliable  to  loss  of  specified  control  channels 
were  developed. 

The  last  topic  presented  in  this  report  deals  with  ifoo-norm  optimal  and  Hoo-norm- 
bounding  controls  for  discrete-time  systems.  Our  contributions  include  the  establishment  of 
a  lower  bound  for  the  achievable  //^-norm  which  complements  the  known  upper  bound.  We 
have  shown  [17]  that 

(A™.(GTPG)),'J  <  Tml.  <  1 

where  P  >  0  satisfies  the  Discrete  ARE  (DARE) 

P  =  HtH  +  AtP[I  +  ( BBt  -  ~GGT)P)-lA 
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subject  to  the  convexity  condition  72  —  GT PG  >  0.  A  study  of  the  properties  of  the 
discrete  convex  Riccati  operator  and  the  derivation  of  the  design  equations  for  the  output- 
feedback  //oo-norm- bounding  controllers  for  discrete  systems  by  utilizing  a  transformation 
of  the  DARE  to  a  Generalized  (continuous)  algebraic  Riccati  equation  (GARE)  are  given 
in  [18].  A  lower  bound  on  the  achievable  tf^-norm  using  output  feedback  controls  was  also 
established. 

The  presentation  of  the  material  has  been  organized  into  five  Sections.  Sections  2  and  3 
deal  primarily  with  results  related  to  the  design  of  low-order  controllers,  and  in  particular 
the  FH  norm  and  its  utilization  in  design,  and  with  projective  controls  as  a  means  of  defin¬ 
ing  a  suitable  parametrized  class  of  low-order  controllers.  Section  4  establishes  the  approach 
used  in  developing  results  for  state- feedback  control,  full-order  output-feedback  control,  and 
decentralized  control.  Section  5  presents  new  results  on  the  design  of  reliable  control  sys¬ 
tems,  for  the  centralized  control  problem  as  well  as  for  decentralized  control  problems  where 
the  problem  of  reliability  with  respect  to  a  loss  of  certain  control  channels  is  resolved.  Sec¬ 
tion  6  presents  extensions  of  the  methodology.  Problems  considered  include  robustness  to 
structured  parametric  uncertainty  in  the  plant,  parametrization  of  classes  of  state-feedback 
and  output-feedback  controls  that  guarantee  an  ffoo-norm  bound,  and  the  discrete  i/oo-norm 
optimization  problem. 
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2  LOW-ORDER  CONTROLLER  DESIGN  BASED 
ON  THE  FH  NORM 

2.1  Motivation  and  Problem  Formulation 


In  this  report,  we  present  methodologies  for  design  of  controllers  to  achieve  closed-loop  per¬ 
formance,  disturbance  rejection,  robustness,  and  reliability  for  multivariable  time-invariant 
linear  systems.  The  systems  will  be  represented  by  state-space  models  or  by  transfer  func¬ 
tions,  as  may  be  appropriate  in  a  particular  problem  setting.  In  the  remainder  of  this  section 
we  specify  the  analytical  representation,  and  the  basic  design  problems  considered  in  this 
section. 

We  consider  systems  described  by 


x  —  Ax  +  Bu  +  Gw0 

yc  =  Hx  (2.1) 

y  —  Cx  +  Du  +  xv 


where  x(t)  G  2R"  is  the  state,  u(t)  €  JR"*  is  the  control,  w0(t)  G  1R?  is  the  disturbance, 
yc(t)  G  Si*  is  the  controlled  output,  y(t)  G  HO*  is  the  measured  output,  and  u)  G  F  is 
measurement  noise.  In  order  to  insure  that  the  desired  control  is  not  achieved  at  the  expense 
of  excessive  use  of  control  energy,  the  controlled  output  is  typically  expanded  to  include  the 
control  vector.  Thus  we  will  here  consider,  in  general,  the  controlled  output  to  be 


yc 

■  Hx  ' 

u 

Kx 

Hcx. 


(2.2) 


Two  types  of  controls  will  be  considered:  Static  output-feedback  controls  where  the  controller 
is  of  the  form 


u  =  Ky, 


(2.3) 


a  particular  case  of  which  is  the  state-feedback  controller  if  C  =  /,  and  dynamic  output- 
feedback  control,  where  the  controller  is  of  the  form 


£  =  Ac(  +  Bcy 
u  =  Cct  +  Dcy. 


(2.4) 


7 


By  introducing  the  extended  system  describing  the  coupled  dynamics  (2.1)  and  (2.4),  the 
dynamic  output-feedback  control  problem  can  be  reduced  to  an  equivalent  static  output- 
feedback  problem 


with 


where 


xe  =  Axe  +  Bit  -f  (jwq 
Vet  =  Hxe  -l-  Eu 
ye  -  Cxe  -(-  Dw 

«  =  Keye 


(2.5) 


(2.6) 


xe  = 

X 

,  A  = 

A  0 
0  0 

H  =  [H  0],  D  = 

‘  D  ‘ 

0 

B  = 


B  0 
0  I 


C  = 


C  0 
0  / 


(2.7) 


,  E  =  [E  0], 


and  with  the  controller  parameters  packed  into  the  equivalent  gain  matrix 

Ke  = 


Dc  Cc 
Bc  Ac 


(2.8) 


We  now  formulate  a  standard  disturbance-rejection  problem  via  the  //oo-norm:  Given 
the  closed- loop  system 

*  :  hXx+GW  (2.9) 

where  w  is  a  disturbance  input,  z  is  a  system  output  to  be  regulated,  and  the  system  matrix 
F  depends  on  the  controller  parameters,  find  a  controller  K(s )  which  guarantees  closed-loop 
stability  and  satisfies 

K(s)  =  arg  inf  |(TT(/r)(|00  (2.10) 

A 

with  T(K\a)  =  H(sl  —  F)~lG.  The  H0 0  norm  is  defined  as 


imU  =  supalMX{T(ju)},  (2.11) 

Uf 

where  }  denotes  the  maximum  singular  value.  The  definition  (2.11)  signifies  that  the 

Hoo  norm  represents  the  largest  size  of  a  transfer-function  matrix  on  the  ju>  axis.  (If  T(s) 
is  a  scalar  transfer  function,  ||T||oo  represents  the  worst-case  amplification  of  a  sinusoidal 
disturbance  input.) 
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An  interpretation  of  the  //,»  norm  in  linear  systems  is  that  it  is  the  worst-case  ratio  of 
output  energy  to  disturbance  energy: 


imu  =  sup 

wtL?  W  2 


(2.12) 


Thus,  an  equivalent  formulation  of  the  disturbance- rejection  problem  (2.10)  is  to  find  a 
controller  satisfying 

K{s)  =  arg  inf  sup  (2.13) 

K(*)  w£La  2 


I<(s)  =  arg  inf  sup{||z||2  :  H|2  <  m}, 

A  (») 


(2.14) 


which  is  a  “minimax”  problem  in  dynamic  game  theory.  This  reformulation  really  repre¬ 
sents  a  return  to  the  original  formulations  of  global  sensitivity  problems  as  zero-sum  games 
between  the  control  and  “nature”  (see  for  example  [3]).  This  was  explicitly  recognized  in 
recent  years,  and  the  minimax  formulation  has  since  proved  to  be  the  proper  vehicle  for  the 
characterization  and  computation  of  Z/oo-norm  optimal  solutions.  It  has  also  been  demon¬ 
strated  that  the  optimal  controllers  can  be  implemented  as  state-feedback  controllers,  and 
that  optimal  output-feedback  controllers  are  of  the  same  order  as  the  plant. 

A  related  formulation  of  the  disturbance-rejection  problem  deals  with  determining  sub- 
optimal  solutions,  which  are  referred  to  here  as  ZZoo-norm-bounding  controls:  Determine  K 
(or  Ke )  such  that  the  resulting  system  is  stable  and 


imu  <  7. 


(2.15) 


for  selected  7  greater  than  the  minimum  achievable  bound.  This  formulation  has  advantages 
over  the  /Zoo-optimization  problem,  in  that  an  optimal  or  near-optimal  solution  is  often 
characterized  by  high  gains,  high  sensitivity  to  design- parameter  variations,  and  excessive 
concern  with  the  worst  disturbance. 

For  low-order  controllers,  the  ZZoo-norm  minimization  problem  and  the  norm-bounding 
problem  still  do  not  have  a  computationally  tractable  solution.  This  prompts  the  consid¬ 
eration  of  alternative  formulations.  We  have  developed  the  FH-norm  formulation  of  the 
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disturbance-rejection  problem,  and  have  developed  computational  algorithms  to  perform 
FH-norm  optimization.  Solutions  to  the  FH-norm  optimization  problem  are  easy  to  com¬ 
pute,  and  avoid  the  high-gain  and  high-sensitivity  problems  of  /foo-optimal  solutions.  A 
relation  between  the  FH  norm  and  the  H <»  norm  allows  quick  determination  of  an  H^- 
norm  bound  once  the  FH-norm  optimal  solution  is  obtained.  The  FH-norm  approach  can 
be  applied  to  both  continuous  and  discrete  systems,  and  is  particularly  appealing  when  the 
system  is  linear  in  the  free  design  parameters.  We,  therefore,  also  develop  appropriate  linear 
in  the  free  parameter  (LIFP)  closed-loop  systems  representations.  In  Section  3  we  proceed 
to  combine  the  FH-norm  approach  with  the  projective  controls  design  methodology. 


2.2  The  Frobenius-Hankel  Norm 


Recently,  Medanic  and  Perkins  [19]  introduced  the  use  of  the  Frobenius-Hankel  (FH) 
norm,  which  is  defined  as  the  Frobenius  norm  on  the  Hankel  singular  values  in  disturbance 
rejection  and  other  control  problems.  The  motivation  for  the  choice  of  this  norm  is  due  to  its 
relationship  to  more  widely  known  norms  such  as  Hi  and  H and  its  good  computational 
properties  which  make  it  suitable  for  use  in  optimization  procedures. 

In  this  section,  the  Frobenius-Hankel  norm  is  defined  and  its  properties  explored.  In 
particular,  both  time-domain  and  frequency-domain  physical  interpretations  will  be  given 
for  the  FH  norm,  and  a  simple  computational  method  will  be  developed  for  calculating  the 
FH  norm.  The  FH  norm  will  also  be  directly  related  to  both  the  Hi  and  Hoo  norms.  In 
the  following  section,  the  FH  norm  will  be  used  as  the  basis  for  a  parameter-optimization 
problem  and  applied  to  a  model-reduction  problem  and  an  optimal  controller  problem. 

The  Hankel  singular  values  of  a  stable  system  are  defined  as  the  singular  values  of  the 
Hankel  operator  associated  with  that  system,  (see  [20].)  If  the  system  is  described  by 


x  =  Ax  +  Bu 
y  —  Cx  +  Du, 


(2.16) 


with  A  Hurwitz,  then  the  Hankel  singular  values  <j{,  i  €  { 1 , 2, . . . ,  n}  can  be  computed  as 


where  P  and  Q  satisfy 


AP  +  PAT  +  BBT  =  0  (2.18) 

ATQ  +  QA  +  CTC  =  0.  (2.19) 

Note  that  P  and  Q  are,  respectively,  the  controllability  and  observability  Grammians  of  the 
system,  and  can  be  defined  by 


Definition  2.1. 


P=  r  eMBBTeAT'dt 
Jo 

Q=  r  eAT,CTCeMdt. 

Jo 

The  Frobenius-Hankel  norm  of  G(s)  6  Hi  is 

r  n  1 1/2 


IIGMII™  4 


I>?{GM> 


y 


List 

where  <r,{  - }  signifies  the  ith  Hankel  singular  value. 


(2.20) 

(2.21) 


(2.22) 


2.3  Properties  of  the  FH  Norm 

The  FH  norm  of  a  given  system  can  be  easily  computed  from  its  controllability  and 
observability  grammians,  P  and  Q. 

Theorem  2.1.  Given  the  system  G(s )  €  //2  and  its  controllability  and  observability  gram¬ 
mians,  P  and  Q  respectively,  then 

l|GW*=  Tr{PQ).  (2.23) 

Proof.  From  Definition  2.1, 

IIGMII2™  =  Tr  £2  (2.24) 

where  E  =  diag  {o\ . . .  on).  Since  there  exists  T  nonsingular  such  that  T~tPT~x  =  E  and 
TQTt  =  E  [20] 

||G(s)l£w  =  Tr  (r-TrT)E(rr-1)E 
=  Tr  (rrET)(r-1ET-T) 
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(2.25) 

(2.26) 


=  Tr  PQ 


(2.27) 


□ 

Note  that  FH-norm  computation  via  Theorem  2.1  involves  the  solution  of  the  two  Lya¬ 
punov  equation  for  P  and  Q,  but  avoids  the  eigenvalue  computation  necessary  to  determine 
the  individual  Hankel  singular  values. 

A  time-domain  interpretation  of  the  FH  norm  is  as  follows: 

Theorem  2.2.  Give n  the  system  G(s)  6  Hi  and  the  impulse  response  of  the  system  g(t), 
then 

lIGMf™  =  Tr  rtg(t)Tg(t)dt.  (2.28) 

Jo 

Proof.  From  Theorem  2.1, 

\\G(s)\\2fh  =  Tr  PQ.  (2.29) 

By  definitions  (2.20)  and  (2.21),  we  obtain 

Tr  PQ  =  lim  Tr  [  F  eMBBTeAT'dt  f  eATrCTCeAr  dr  ,  (2.30) 

T-*  °°  [Jo  |yo 

which  is  equivalent  to 

Tr  PQ  =  Hm  Tr  J  £  [CeA(‘+r)flj  \CeA^+T)B]T  dt  dr.  (2.31) 

Let  g(r)  =  CeAr B , 

Tr  PQ  =  lim  Tr  [  f  git  4-  t)t git  +  r)  dt  dr  (2.32) 

T—oo  Jo  Jo 

JfT  rT+r 

'  /  g(t)Tg(t)  dt  dr.  (2.33) 

0  Jr 

Let  H(T)±f?+’g(t)Tg(t)dt. 

Tr  PQ  =  \\m  Tr  J  H{r)dT.  (2.34) 

Integrating  by  parts, 

Tr  PQ  =  ^lirn^  Tr  H(t)t\%  -  j  rdH(r )  (2.35) 
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Tr  PQ  =  lim  Tr 
r-oo 


[jf  ( T  -  t)g(t  +  T)Tg(t  +  T)  +  tg(t)Tg(t)  dt 
In  the  limit  as  T  — ►  oo,  g(t  -f  T)  — *  0  and  thus 

TtPQ=  Tr  f°°  tg(t)Tg(t)  dt. 

Jo 


(2.3G) 

(2.37) 

□ 


The  following  result  provides  frequency-domain  properties  of  the  FH  norm. 

Theorem  2.3.  Given  the  system  G(s)  6  H 2  and  the  frequency  response  of  the  system 
G{ju)  =  G(s)  then 


IIGMII1™  =  £  jf  Tr  du,. 


-oo  dui 

Proof.  Applying  Parseval’s  Theorem  to  (2.31)  yields 

1  r°° 


=  2^  /_~ Tr  ntmmw  ^ 


(2.38) 

(2.39) 

(2.40) 
□ 


2.4  Relationships  with  Other  Norms 

The  Frobenius-Hankel  norm  can  be  related  to  the  norm  through  the  Hankel  singular 
values  of  the  system. 

Theorem  2.4.  For  a  stable  system 

*(GM)  <  IIGWIIfw  <  X>{C«}  (2.41) 

«=1 

and 

fh  <  ||G(a)||oo  <  2y/n\\G{s)\\FH.  (2.42) 

Remark:  It  has  been  shown  [20],  that 

*(CM)  <  IIGMIU  <  2 £>,(G(»)).  (2.43) 

1=1 
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Proof.  Consider  (2.41).  Clearly,  E"=1<72  >  <73,  while 


(S')'  -  (£-)  (S- 


(2.44) 


=  si 

=  ±<d  +  t  tw 

k= 1  *»■ ;=1 

>  P"l 

>  ||Gr('s)llf’H- 


Consider  now  (2.42).  We  have  ]P<72  <  n<73  and  so  (l/Vn)i|G!(3)||FH  <  a  <  ||G(s)||c 


»—  A 

On  the  other  hand,  we  have  that  given  a  value  of  the  FH  norm, 

aTa  =  £<7?=1  =  ||G(s)||fj/,  °r  =  Wi  *2  •  •  •  *»] 

i=i 


(2.45) 


the  maximal  value  of  the  sum  <Ti  is  obtained  by  solving  the  maximization  problem 


lin  er<7,  eT  =  [1  1 ...  1], 


(2.46) 


subject  to  (2.45).  This  leads  to  the  maximizer  cr  =  Ae  where  A  must  satisfy  (2.45),  producing 
A2n  =  ||(7(s)||FW.  But  then 


Y>,  =  eTa  =  Aere  =  An  =  >/n||Gf(s)|jFH. 

:=i 

For  all  other  values  of  the  <7,,  £"=1  <  ■v/t7||G?(3)||f«'  and  so 

l|C(<)IU  <  2 ±a>  <  2v^||G(s)||™. 


(2.47) 


(2.48) 


The  FH  norm  can  aiso  be  related  to  the  sensitivity  of  the  Hi  norm  to  a  shift  of  the 
eigenvalues  of  the  system  along  the  real  axis. 


Theorem  2.5.  Let  the  eigenvalues  of  the  system  Ga(s )  be  given  by  A i  =  A,  +  a,  then 


■^WGMWl  =  2||G(3)||2fw. 

o=0 


(2.49) 


14 


Proof.  The  shift  in  eigenvalues  can  be  expressed  by  assuming  A  has  the  form 


A(a)  =  A0  +  al. 


Let 


Then 


where  Pa  satisfies 


J=  ||G(s)|||  =  Tr  PCTC. 


dJ 

da 


=  Tr  PaCTC, 


or=0 


APa  +  PaAT  +  2P  =  0. 


Let  Q  satisfy 

QA  +  AtQ  +  CTC  =  0 

then  using  the  properties  of  the  trace,  it  can  be  shown  that 

Tr  PaCTC  =  2  Tr  PQ. 


Thus 


dJ 

da 


=  2  Tr  PQ. 


Q=0 


(2.50) 

(2.51) 

(2.52) 

(2.53) 

(2.54) 

(2.55) 

(2.56) 


This  expression  may  be  useful  in  establishing  robustness  properties  of  the  system. 

2.4.1  Example 

To  illustrate  the  relationship  between  the  various  norm  and  the  effect  of  their  minimization 
on  the  system  response  consider  the  system 

x  = 

Vc  = 

y  = 

with  control  restricted  to 


0  1  ' 

'  1  ' 

'  1  ' 

—a  0 

x  + 

0 

u  + 

0 

[1  0)z 

(0  l]x 

it  =  —ky  =  —  [0  k]x. 
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It  is  then  easily  shown  that 

mi2  (1  +  a2)k2  +  a  ,2  .  2  a 

#GW™» - 2 ~k - ’  *’  =  “g  T l|G|lj  =  TTa 

and 

lIGWHJw  = 

Moreover, 


|2  _  (1  +  a2)k*  +  2a3k2  +  2a2  2 


4  k2a2 


,  kpff  =  arg  nun  ||G||fh  =  -7=== 
*  Va2  +  1 


I|G(*)IIL  =  •/(“>(*),*)  -  max 


and  so 


\\G(s)\\l  =  { 


f  u;2  +  k2(  1  +  a2)  1 
\  (a;2  —  at)2  -(-  k2w2  J 

J(u(k),k :),  fc2  <  a  + 


fc2(l+a2)  ,2^  .  I  a2 +  2 

- - -  k2  >a  +  a\  -  -- 

Q2  V  «2  +  1 

with  u>2(A:)  defined  implicitely  as  satisfying  the  necessary  condition 


u>*  +  2fc2(l  +  a2)u/2  —  5  =  0 


and 


5  =  a2(a2  +  2)  —  (1  +  a2)(fc2  —  a)2 

Because  for  6  >  0,  ||G(s)||oo  is  unimodal  and  exhibits  a  maximum,  and  is  monotonically 
decreasing  for  6  <  0,  it  is  determined  that 


l2  Hi-/  ui2  l+2a2-\/TTa2 

koo  =  arg  nun  ||G(s)||L  = - -==  - . 

*  QV 1  +  a2 

The  dependency  of  k\,  k2FH  and  k ^  on  a  is  depicted  on  Figure  2.1. 

It  is  noted  that  as  a  — ►  oo,  all  gains  are  bounded,  so  that  high  oscillation  will  result  in 
all  cases.  The  reason  is  that  consideration  of  the  control  as  an  additional  controlled  output 
precludes  the  use  of  large  gains.  If  the  control  is  not  weighted  then  one  obtains 

k2  +  a 


\\G(sM  ~ 


12  — 


l|G(-)ll?~  ~ 


I FH  - 


2  ak 

k *  +  2a2 
4Jfc2a2 
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control  gains  with  the  control  weighted-in 


a 


Figure  2.1:  Optimal  gains. 


and 


\\G{s)\\l  = 


w2  +  k2 

(w2  —  a)2  +  k2w2 


From  this  follows 


k\ 

kpfj 

kl 


a 

ay/2 

3a 


2 


and  the  results  are  displayed  in  Figure  2.2.  Thus,  we  see  again,  the  characteristic  property 
that  the  FH  norm  optimal  solution  provides  more  damping  than  the  LQ  solution,  but  not 
as  much  as  the  H0 o-norm  optimal  solution  which,  of  course,  reduces  the  peak  of  the  gain 
characteristic.  In  this  case,  for  all  values  of  a,  the  H <*,  norm  solution  guarantees  a  damping 
ration  (  =  ^  =  0.6124,  the  FH  norm  solution  guarantees  £  =  ^  =  0.5946,  which  the  H 2 
solution  guarantees  £  =  0.5. 
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control  gains  with  no  weighting  on  the  control 


2.5  Frobenius-Hankel  Norm  Optimization 

In  this  section,  a  common  framework  for  solving  optimal  FH  norm  problems  will  be  pre¬ 
sented.  Necessary  conditions  for  an  optimal  solution  will  then  be  formulated  and  solution 
methods  for  solving  the  necessary  conditions  will  be  proposed.  In  later  sections,  specific 
problems  will  be  solved  under  this  framework,  and  in  particular  problems  related  to  the 
design  of  projective  controls. 

Let  G(s)  be  a  strictly  proper  system  with  transfer  function 

G(s)  =  C(9){sl  -  A(6))~lB{6)  (2.57) 

parameterized  by  9.  The  general  method  used  to  compute  optimal  FH  norm  solutions 
involves  determining  the  optimal  values  of  the  free  parameters  of  the  coatroller.  For  example, 
in  the  case  of  the  model- reduction  problem,  the  parameters  represent  the  reduced-order 
system,  i.e.,  0  =  (A,  B,C,  D).  In  the  controller- synthes is  problem,  the  parameters  represent 
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the  controller,  i.e.,  0  =  (Ac,  Bc,Cc ,  Dc).  The  FH  norm  of  G(s)  can  be  computed  as 

J  =  IIGWIIJt,  =  Tr  {/><?}  (2.58) 

where  P  and  Q  satisfy  (2.18)  and  (2.19).  The  optimization  problem  is,  thus,  to  find  0  such 
that  the  criterion  (2.58)  is  minimized  subject  to  the  constraints  (2.18)  and  (2.19). 

This  constrained  optimization  problem  can  be  converted  to  an  unconstrained  optimiza¬ 
tion  problem  using  Lagrange  multipliers.  The  augmented  criterion  is  given  by 

J  =  Tr  { PQ  +  M(AP  +  PAt  +  BBT)  +  L(ATQ  +  QA  +  CTC)}.  (2.59) 


Using  this  approach,  necessary  conditions  for  an  optimal  solution  are 

dJ 


dP 

d£ 

dQ 


=  AtM  +MA+Q=0 
=  AL  +  LAt  +  P  =  0 


=  AP  +  PAt  +  BBt  =  0 
oL 

^-  =  ArQ  +  QA-r  CTC  =  0 
dM 

^  Tr  {2 Ar(MP  +  QL)  +  BT MB  +  CTCL }  =  0. 


(2.60) 

(2.61) 

(2.62) 

(2.63) 

(2.64) 


In  general,  these  equations  can  not  be  solved  for  the  optimal  9  directly.  However,  iterative 
methods  may  be  applied  to  this  problem. 

A  Gradient  algorithm  approach  to  the  solution  of  this  problem  is  to  find  the  direction  of 
steepest  descent  and  to  take  a  step  in  that  direction.  The  direction  of  steepest  descent  is  in 
the  direction  of  the  gradient  with  respect  to  9\  the  gradient  of  J  with  respect  to  0  is  given 
by 

dJ  dJ  dJdP  dJdQ  dJdL  dJ  dM 

d9  ~  d0  +  dP  d0  +  dQ  d0  +  OL  dd  +  dM  d9‘  (2'65) 

If  P,Q,  L,M  satisfy  (2.60-2.63),  then 


dJ__dJ_ 
dO  ~d9 


(2.66) 
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The  parameter  update  is  given  by 

0*1  =  0i  -  (2.67) 

Basic  steps  of  the  algorithm  are  given  in  Figure  2.3,  for  c  fixed.  This  method  has  been  used 

1.  Select  0O  so  that  A(0O)  is  stable. 

2.  Let  i  =  l. 

3.  Solve  Eqns.  (2.60)-(2.63)  for  L,  M,  P  and  Q. 

4.  Calculate  0^+1  from  Eqns.  (2.66)  and  (2.67). 

5.  If  the  parameters  have  not  converged,  let  t  =  i  +  1  and  go  to  2. 

Figure  2.3:  Gradient  Algorithm. 


in  [4]  to  solve  the  FH  optimization  subproblem,  associated  with  the  decentralized  control  of 
a  large  space  structure  using  low-order  controllers.  The  steepest  decent  algorithm  results  if 
G  is  selected  so  that  0,+1  is  the  minimum  of  J  along  the  gradient  direction. 

An  alternative  approach,  referred  to  here  as  “the  Riccati  approach”,  [21,8]  uses  Riccati 
equations  instead  of  Lyapunov  equations.  The  Riccati  equations  are  constructed  so  that  the 
iterative  solution  converges  to  the  solution  of  the  Lyapunov  equations. 

The  iterative  equations  are  of  the  general  form 


ATM,+i  +  Mi+iA  —  Mi+iRMi+i  +  MiRMi  +  Q  —  0 
AL{+ 1  +  Li+iAT  —  Li+iRLi+i  +  LiRLi  +  P  =  0 
APi+i  +  Pi+iAT  —  Pi+iRPi+i  +  PiRPi  +  BBT  =  0 
ATQi+ 1  +  Qi+iA  —  Qi+iRQi+i  +  QiRQi  +  CTC  =  0 


where  0,  is  the  solution  of  (2.67),  or  the  solution  of 


dJ  n 
dO  ~  °’ 


(2.69) 


if  (2.69)  can  be  solved.  The  second  possibility  occurs  naturally  in  the  discrete  case  and  so 
the  algorithm  will  be  discussed  in  Section  2.6  in  greater  detail.  Note  that  if  this  iterative 
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algorithm  converges,  it  converges  to  the  solution  of  the  corresponding  Lyapunov  equations. 
The  Riccati  approach  has  the  important  feature  of  being  solvable  for  all  stabilizable  and 
detectable  systems.  The  Riccati  approach  should  be  used  when  c  is  fixed,  since  an  unstable 
plant  may  then  result  at  any  given  iteration.  However,  solving  Riccati  equations  is  more 
time-consuming  at  each  iteration  than  solving  Lyapunov  equations;  therefore,  the  increased 
assurance  of  convergence  is  obtained  at  the  cost  of  greater  computational  burden. 


2.5.1  Optimal  model  reduction 

The  disturbance-rejection  problem  is  a  useful  paradigm  for  other  problems,  in  particular  for 
the  model- reference  problem  and  model- reduction  problem.  In  the  model  reduction  problem, 
given  an  nth-order  system 

G(3)  =  C{3l-A)-1B  +  D ,  (2.70) 

the  problem  is  to  find  a  k- th  order  approximation 

G{s)  =  C{sI-A)~1B  +  D  (2.71) 

that  minimizes  ||G(s)  —  G(s)||/rW. 

The  error  system  as  shown  in  Figure  2.4  is 

- *  G(») 

- -  G(s) 

Figure  2.4:  Model  Reduction  Problem. 


E(s)  =  G(s)  -  G(3)  =  Ce(sl  -  Ae)-'Be  +  De,  (2.72) 


where 


A  =  I  A  0 

e  1  0  A 


,  Be  = 


B 

A 

B 


,  Ce  =  [C  -  £\  ,  De  =  D-D.  (2.73) 
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In  order  for  the  error  system  to  be  strictly  proper,  i.e.,  that  e(t) 
require  De  =  0.  This  is  satisfied  by  letting  D  =  D. 

The  necessary  conditions  from  (2.60)-(2.64)  are: 

=  AeP  +  PAJ  +  BeBj  =  0 

=  A?Q  +  QAe  +  CjCe  =  0 

oM 

=  A^M  +  MA'  +  Q-  O 

%  -  a,l  +  la:  +  p  =  0 


0  as  t  — *  oo,  we 


(2.74) 


and 


|i  =  2(MP  +  QL)z2  —  0 
dA 

I  =  2{MnB  +  M22B)  =  0 

dB 

H  =  2(-Ci12  +  6m,l)  =  0. 
aC 


(2.75) 


The  gradient  steepest  descent  or  Riccati  algorithm  can  now  be  used  essentially  as  described. 
2.5.2  Disturbance  rejection 

Given  the  plant  (2.1)  controlled  by  the  dynamic  controller  (2.4),  the  closed-loop  system 
reduces  to  (2.5)-(2.7),  i.e., 


A  =  A  +  BKC 
B  =  6+BKD 
C  =  ti  +  EKd 

d  =  Ski) 


(2.76) 


with 


A  = 


A  0 
0  0 


B  = 


B  0 
0  I 


C  = 


C  0 
0  I 


D  = 


D 

0 


E  =  [E  0],  G  = 


G 

0 


H  =  [H  0],  I<  = 


Dc  Cc 
Bc  Ac 


(2.77) 


(2.78) 


In  order  for  the  closed-loop  system  to  be  strictly  proper,  we  require  D  =  0.  Thus  one 
restriction  on  the  optimal  solution  is 


EDCD  =  0. 


(2.79) 
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Figure  2.5:  Plant  with  controller  configuration  for  disturbance  rejection. 


Of  course  (2.79)  can  be  satisfied  in  a  combination  of  these  three  cases.  This  would  imply 
that  some  channels  of  the  control  would  be  strictly  proper,  some  noise-free,  and  some  with 
cheap  control. 

If  the  measurement  noise  ( DDT )  is  non-singular  and  the  controlled  outputs  include  a 
non-singular  control  term  ( ETE ),  then  the  optimal  controller  must  be  strictly  proper.  This 
case  is  handled  by  setting  Dc  —  0  and  removing  it  from  the  set  of  parameters  to  be  optimized. 


Thus  the  necessary  conditions  for  an  optimal  controller  are  (2.80)  and 

2  (A/P  +  QL)22  =  0 

2{(MP  +  QL)2lCT  +  M22BCDDT)  =  0  (2.82) 

2  [Bt{MP  +  QL)U  +  ETECcL22 ]  =  0. 

If  the  measurement  outputs  of  the  plant  are  noise-free,  then  D  =  0  and  the  necessary 
conditions  for  an  optimal  controller  are  (2.80)  and 


dJ 

dAc 

8J 

dBc 

dJ 

dCc 


=  2(MP  +  QL)22  =  0 

vAp 

=  2[(MP  -f  QL)2\Ct  +  (M22Bc  +  M2\BDc)DDt]  =  0 

(2.83) 

=  2Br(MP  +  gL)12  =  0 

aCjp 

4^-  =  2[Br(MufiI>c  +  M125c)Z)DT  +  BT(MP-fgi)11CT]=0. 
a£?c 

If,  in  addition  the  controller  is  non-dynamic,  i.e.,  C(s)  =  Dc,  then  the  closed-loop  system 


is 


G{s)  =  {H  +  EDcC){sI  -A-  BDcC)-lG . 
The  necessary  conditions  for  an  optimal  control  are  (2.80)  and 

-1^-  =  Bt(LP  +  QM)Ct  +  DcCMCt  =  0. 
oDc 


(2.84) 


(2.85) 


2.5.3  Example 
Given  the  plant 


'  A 

B 

C 

D 

r  -0.4335 

-0.0118 

-0.9231 

-0.4643 

0.8854 

-0.7382  1 

-0.9160 

-0.5185 

-0.4110 

-0.0779 

0.1747 

1.5473 

-0.0414 

-0.6085 

-0.7507 

-0.8901 

-1.4939 

0.8204 

-0.4828 

-0.0916 

-0.2014 

-0.9215 

-1.1423 

-1.5361 

0.9782 

1.9938 

-0.8140 

-0.8819 

0 

-1.5443 

0.1821 

0.3387 

1.6250 

1.0326 

0 

0  . 

(2.86) 


determine  a  second-order,  proper,  stabilizing  controller  K{s)  which  minimizes  the  FH  norm 
of  the  closed-loop  system. 
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To  start  the  algorithm,  an  initial  stabilizing  controller  is  needed.  Such  a  controller  is 
given  by 


K(s)  = 


-1  0 

0  -1 

0.0846  -0.1728 


0  -0.0118 
-1  -0.0555 
728  0 


(2.87) 


The  optimal  controller  was  computed  by  implementing  the  steepest  decent  algorithm 
using  Matlab.  Figure  2.6  shows  the  FH  norm  (G  =  B,  H  —  C)  at  each  iteration  of  the 


Figure  2.6:  Iteration  history  of  FH  Norm  of  System. 


algorithm.  The  FH  norm  was  reduced  from  its  initial  value  of  84.9  down  to  5.6.  The  optimal 
controller  is  determined  to  be 


[  -0.7966  -0.2337 

-0.4563  ] 

K(s)  = 

-0.2502  -0.7149 

0.5331 

0.4515  -0.5542 

0.1822 

2.6  Discrete-Time  Systems 

In  this  section,  we  describe  in  detail  the  FH-norm  approach  to  disturbance  minimization  in 
discrete-time  systems,  and  propose  the  new  Riccati  equation  based  computational  algorithm 
for  the  design  of  an  FH-optimal  controller  of  selected  order. 

The  formulation,  as  will  be  seen,  reduces  to  a  linear-in-the-free-parameters  (LIFP)  system 
description  coupled  with  a  performance  criterion  that  leads  to  a  Parametric  Optimization 


(PO)  problem.  The  necessary  conditions  for  optimality  are  derived,  and  a  fixed-point  algo¬ 
rithm  involving  the  iterative  solution  of  Lyapunov  equations  is  suggested  by  the  structure  of 
the  necessary  conditions.  Presently  available  algorithms  require  an  initially  stable  system. 
To  resolve  this  initialization  problem  and  aid  convergence,  a  new  algorithm  is  proposed  which 
involves  the  iterative  solutions  of  discrete  Riccati-equations. 

2.6.1  The  disturbance-rejection  problem  in  discrete-time  systems 

Consider  the  disturbance-rejection  problem  for  the  system  in  Figure  2.7,  where  u  is  the 


Figure  2.7:  System  with  external  disturbance. 

control  vector,  £  is  the  controlled  output  vector,  w  is  the  disturbance  vector,  and  y  is  the 
measured  output  vector.  The  goal  is  to  suppress  the  response  in  the  output  £  due  to  the 
disturbance  w.  Consider  the  linear,  time-invariant,  discrete-time,  stochastic  state-space 
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system 


xk+i  =  Axk  +  Buk  4-  Ewk 

yk  =  Cxk  +  Fwk  (2.88) 

Cfc  =  Dxk 

with  xk  €  K”,  Cfe  €  1FT,  uk  €  2R*,  yk  €  FT,  wk  €  iR®,  and  'L'^=lw^wk  <  oo,  and  with  the 
linear  controller 

^+1  =  (2.89) 

u*  =  K^k  4-  K4yk 

where  £k  €  2R'  and  all  the  parameters  of  the  dynamic  compensator  are  free  design  parameters. 
Letting  xe<k  —  [x*  £j]T,  we  get  the  closed-loop  system 


xe,k+i  =  Acxe<k  4-  Ecwk 
Ck  =  Dcxe>k 


(2.90) 


where 


Ac  =  A  +  BKC,  EC  =  E  +  BKF,  DC  =  [D  0 ]E  =  [ET  0]T,  F  =  [FT  0]T 

and 

Then  Gc(z)  =  Dc(zl  —  Ac)~l Ec  represents  the  closed-loop  transfer  function  from  the  distur¬ 
bance  input  to  the  regulated  output  C(z)  =  Gc{z)w(z). 

In  the  spirit  of  the  /foo-norm  optimization,  the  optimal  solution  to  the  disturbance- 
rejection  problem  can  be  defined  as 

K°  =  arg  min  ||Gc(r)||0O  (2.92) 

A 

where 

||Gc(z)||oo  =  max  <rmax{Gc(z)}.  (2.93) 

1*1=1 

Finding  a  minimum  with  respect  to  the  norm,  however,  presents  computational 
problems  as  formidable  as  in  the  continuous  case  since  there  are  no  efficient  algorithms  to 
solve  the  ensuing  minimax  problem  involving  a  controller  of  constrained  structure. 

The  FH  norm  of  the  discrete-time  system  (2.90),  similar  to  that  of  a  continuous-time 
system,  is  defined  in  terms  of  Hankel  singular  values  and  is  computed  from  the  product  of 


B  = 


B  0 
0  /. 


C  = 


G  0 
0  /, 


K  = 


K<  K3 
k2  Kx 


(2.91) 
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the  controllability  and  observability  grammians,  P  and  Q.  For  Ac  a  stability  matrix,  P  and 
Q  are  defined  in  the  discrete  case  as 


OO 


p  =  '£A^Et(Ac)k' 

(2.94) 

Jb=0 

(2.95) 

k=0 

and  satisfy  the  Lyapunov  equations 

ACPA*-P  +  ECE •  =  0 

a:qac-q  +  d*cdc  =  0. 

(2.96) 

The  Hankel  singular  values  are  defined  as 


<Ti(G«(*))  =  y/Xi (P  Q),  (2.97) 


and  can  also  be  derived  from  the  singular  values  of  the  Hankel  matrix  [20,22].  The  FH  norm 
is  given  by 

| n+*  | n+ a  # _ 

(2.98) 


iiawii™  i .  = 

'  «=i 


ZHPQ)  =  y/Yl  ( PQ ) 


Nft 


if  |A,(i4)|  <  1  Vi.  Recall  that  even  though  the  matrices  P  and  Q  are  not  independent  of 
state  transformation,  the  eigenvalues  of  the  product  PQ  are  invariant  under  such  transfor¬ 
mations  [20]. 

As  has  been  shown,  the  FH  norm  and  the  Hankel  singular  values  satisfy  the  bounding 
relations  _ 


v™ *(Gc{z))  < 


n+* 


n+j 


,|  S>?(G0(*))  =  |G,(*)||ra  <  S>(Gc(z)) 

N  i=i  <=i 


and 


n+t 


<W(G«(*))  <  ||Gt(z)|U  <  2£<T((Ge(»)). 


1=1 


Introducing  the  notation  for  the  Trace-norm  (T-norm)  and  Hankel  norm 


n+« 


l|C«(r)||r  =  £*(Gc(z)),  II  G«(z)||»  =  ^(Gc(z)) 

•= 1 


and  the  interval  J  of  the  real  line  defined  by 


J^[||G(2)||„,2||Gc(2)||r], 


(2.99) 


(2.100) 


(2.101) 


(2.102) 
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it  follows  that  ||£7c(z)||oo  €  Z  and  ||Gc(2)||f//  6  Z.  Recall  also  that  if  ||Gc(z)||f7/  =  6, 
then  min  ||Gc(z)||//  =  6  while  max  ||Gc(^)||r  =  \/n6,  and  so  the  largest  that  Z  can  be  is 

[•^$, 2y/n6]y  and,  similarly,  the  smallest  Z  reduces  to  the  set  [£,2£].  Thus,  as  j|Gc(z)||f7/  is 
reduced  by  minimization  the  interval  Z  is  also  reduced  and  the  FH  norm  and  the  norm 
are  forced  to  move  closer  together.  The  FG  norm  minimization  procedure  thus  provides  a 
near- /Zoo-optimal  solution,  as  depicted  in  Figure  2.8  (where  G’(z)  is  the  transfer  function  of 


Figure  2.8:  The  effect  of  optimization  on  Z. 

the  optimized  system).  This  will  be  amply  demonstrated  by  an  example  in  Section  2.7.1. 
2.6.2  The  FH-norm  optimization 

The  FH-norm  optimization  in  discrete  systems  problem  reduces  to  the  minimization  of 
the  criterion 

J  =  ||£c(z)||Jtj  =  tr  ( PQ ),  (2.103) 
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where  P  and  Q  satisfy  the  Lyapunov  equation  (2.96).  The  goal  of  the  optimization  is  to  find 
Km  such  that 

Km  =  arg  min  tr  ( PQ ).  (2.104) 

A 

To  convert  constrained  optimization  to  an  unconstrained  optimization,  we  define  again 
the  Lagrange  multiplier  matrices  L  6  2R"xn  and  M  €  iR”xn,  L  =  LT,  and  M  =  MT , 
following  the  approach  developed  for  continuous-time  case.  This  leads,  in  the  discrete  case, 
to  the  extended  cost  function 

J  =  Tr  [PQ  A  M{AcPAtc  -  PA  EcEj)  A  L(ATCQAC  -Q  +  DjDc)\  (2.105) 

and  the  following  necessary  conditions  for  a  minimum: 

=  AjMAc-M  +  Q  =  0 
=  ACLATC-L  +  P  =  0 

(2.106) 

=  acpaJ  -pa  eceJ  =  o 

=  AjQAc  -  M  A  DjDc  =  0 

~  =  2 [C{PATcM  A  LAtcQ)  +  FEjM]B  =  0,  (2.107) 

where  the  derivative  of  a  scalar  with  respect  to  a  matrix  is  defined  in  the  usual  sense.  We  see 
that  equations  (2.106)  are  quadratic  in  the  parameter  matrix  K,  and  that  equation  (2.107) 
is  linear  in  K.  Equation  (2.107)  can  be  rewritten  in  the  form 

U\KV\  A  U2KV2  =  A,  (2.108) 

where 

Ux  =  StMB,  Vx  =  CPCT  A  FFT ,  U2  =  BTQB,  V2  =  CLCT 
A  =  -Bt[(MAP  A  QAL)Ct  A  MEFt). 

The  linear-in-the-parameter  form  of  condition  (2.107),  which  does  not  arise  in  the  analogous 
continuous-time  problem  [23],  arises  here  because  of  the  structure  of  the  discrete  Lyapunov 
equation. 


dJ_ 

dP 

dJ 

dQ 

dJ 

dM 

dJ_ 

dL 
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The  use  of  numerical  techniques  is  the  only  viable  approach  to  the  solution  of  the  above 
necessary  conditions.  Fixed-point  or  feasible  direction  algorithms  as  suggested  by  the  form 
of  the  necessary  conditions,  may  be  considered.  However,  convergence  of  the  feasible  direct 
algorithm  is  slow  while  convergence  of  the  fixed  point  algorithm  is  not  guaranteed:  At  some 
iteration,  a  destabilizing  Kj  might  arise,  so  that  the  matrices  Pj,  Qj ,  Lj  and  M,  will  not 
be  positive  definite,  and  the  algorithm  cannot  continue;  or,  while  the  algorithm  might  never 
encounter  this  difficulty,  it  may  still  not  converge.  Problems  such  as  this  frequently  occur  in 
parametric  optimization  problems  (see  [24]). 

2.7  The  Riccati-Based  Algorithm 

To  improve  computational  efficiency,  resolve  the  initialization  problem  [24],  and  achieve 
convergence,  we  use  an  algebraic  Riccati-equation  approach  for  computing  the  FH-norm 
optimal  controller.  This  approach  is  the  forerunner  of  the  Riccati  approach  mentioned  in 
Section  2.5  for  continuous-time  case,  and  is  treated  here  in  greater  detail.  The  use  of  the 
Riccati  equations  is  again  proposed  because  of  robust  properties  of  positive  semi-definite 
solutions  of  these  equations,  and  because  of  their  relationship  to  the  corresponding  Lyapunov 
equations  (2.106). 

Consider  the  Discrete  Algebraic  Riccati  Equation  (DARE) 

APAt  -P  +  S-  AP{P  +  R)-1  PAt  =  0  (2.109) 

for  5  >  0,  R  >  0.  This  has  the  same  terms  as  the  Lyapunov  equation  except  for  the 
“rational”  term  AP(P  +  R)~x  PAT .  Recall  the  following  fundamental  property. 

Lemma  2.1  [25].  If  (A,  5)  is  a  stabilizable  pair,  then  there  exists  a  P  >  0  that  solves 
equation  (2.109).  □ 

If  5  is  positive  definite  then  (A,  5)  is  obviously  stabilizable,  and  so  P  is  positive  defi¬ 
nite  regardless  of  the  stability  of  A.  This  fact  is  exploited  to  construct  an  algorithm  that 
overcomes  the  initial  stabilization  problem.  This  property  also  guarantees  the  continuation 
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of  the  algorithm  through  successive  iterations  by  generating  positive  definite  solutions  to 
Riccati  tquations  constructed  from  the  Lyapunov  equations  (2.106). 

To  adapt  the  Lyapunov-equation  type  conditions  into  a  Riccati  setting,  we  examine,  for 
example,  the  jth  iterate  of  the  third  equation  in  (2.106) 

0  =  AcjPj+iAjj  —  Pj+l  +  Sj  (2.110) 

where  S,  =  EcjEJj.  We  may  expand  this  into  the  DARE  form 

0  =  ACJP,^Al,  -  Pi*,  +S‘-  A'jPi+l(Pi+l  +  RY'P^Al,  (2.111) 

where  S'  is  now  given  by  S'  =  S3  +  AcjPj(Pj  +  R)~l  PjA*  ■.  If  p  is  a  fixed  point  of  this 
algorithm,  (i.e.,  if  Pj  —*  P  as  j  — ►  oo),  then  in  the  limit  (2.111)  converges  to  (2.110).  We 
use  the  same  expansion  technique  on  the  other  three  Lyapunov  equations  and  construct  an 
algorithm  based  on  the  iteration  of  the  obtained  Riccati  equation  in  the  spirit  of  fixed  point 
algorithms. 

Algorithm: 

1)  Set  K0  (arbitrary),  R  >  0,  e  >  0,  and  let  P0  =  Qa  =  L0  =  M0  =  / 

2)  Compute  Acj  =  A  +  BKjC ,  Ecj  =  E  +  BKjF 

3)  Sol/e  the  DARE  equations 

0  =  AcjPj+iAJj  —  PJ+i  +  Si_,  —  Ac<]Pj+\(P]+i  +  R)~l  Pj+iAjj 
0  =  Aj}Q]+\ACiJ  -  Qj+i  +  S2j  —  A*]Qj+l(Q}+l  4-  R)~lQj+\ACt] 

0  =  Ac'jLj+iAjj  —  LJ+i  +  S3j  —  AcjLj+i(LJ+i  +  R)~l  Lj+xAjj 
0  =  AjjMj+\AC}}  —  Mj+i  +  S4J  —  AjjM}+i(Mj+i  +  R)~l  Mj+iAcj 

for  Pj+uQJ+l,Lj+i,  and  Mj+l,  where 

Su  =  EcjEjj  +  AcjPj(Pj  +  R)~lPjA*j, 

S1}  =  DjDc  +  AjjQj(Qj  +  R)~lQjAcj 
S3y  =  P3  +  AcjLjiLj  +  R)-lL,ATC], 

S*j  =  Qi  +  AZjMjiMj  +  ID-'M/A^ 

4)  Solve  equation  (2.108)  for  K}+1 
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5)  If  ||A'J+1  -  Kj ||  >  e,  go  to  2);  else  stop. 

This  approach  has  several  appealing  features.  First  of  all,  Pj  and  Qj  (and  hence  L,  and 
Mj )  always  have  positive  definite  solutions  if  Sij  and  S^j  are  positive  definite.  This  will 
always  be  true  if  PQ  and  Q0  are  chosen  positive  definite  (e.g.,  PQ  =  Qa  =  I).  The  second 
feature  is  the  introduction  of  the  matrix  R  in  (2.111)  which  can  be  used  to  control  speed  of 
convergence  of  the  algorithm.  This  property  can  be  seen  in  that  for  R  >  0  and  large,  the 
Riccati  equation  (2.111)  approaches  the  corresponding  Lyapunov  equation  (2.110). 

If  K j  is  not  stabilizing  for  some  j  >  0,  the  algorithm  still  generates  positive  definite  Pj,  Qj , 
Lj ,  Mj,  and  so  the  updates  of  K j  may  still  be  obtained  uniquely  from  (2.108).  In  particular, 
any  Ka  €  iR(p+,)*(r+*)i  can  be  used  as  an  initial  starting  point,  (unlike  algorithms  that  iterate 
on  Lyapunov  equations),  resolving  the  initialization  problem.  The  Riccati  solutions  may  be 
obtained  by  eigenvector  or  Schur  methods  [26].  Equation  (2.108)  may  be  solved  by  Schur 
methods  [27]. 


2.7.1  An  example 


The  example  used  is  a  fifth-order  plant  and  second-order  controller.  There  are  three 


measured  outputs,  two  control  inputs,  two  disturbances,  and  two  regulated  outputs.  The 
system  was  open-loop  unstable  and  the  initial  gain,  chosen  at  random,  was  not  stabilizing. 


The  matrices  in  this  example  are 


'  0.7090  0.2174  0.2156  0.2471  0.2714  ' 
0.9167  0.6322  0.4611  0.1519  0.1583 

'  0.4218  0.6696  ' 
0.9280  0.7232 

A  = 

0.4492  0.0208  0.9797  0.2248  0.3055 

0.2074  0.6609  0.6527  0.4585  0.2312 

0.6020  0.9731  0.5431  0.5976  0.9319 

,  B  = 

0.3669  0.7510 
0.2272  0.3142 
0.4842  0.3740 

:  0.5190  0.3851  0.6518  0.1310  0.2305  : 

:  0.7631  0.4555  ; 

C  = 

0.5971  0.4729  0.5466  0.5970  0.5064 

,  F  = 

0.0501  0.5027 

_  0.3805  0.3592  0.8039  0.2023  0.1848 

0.6824  0.2716 
0.6911  0.8366  ' 

D  = 

'  0.1958  0.5790  0.8710  0.9427  0.0715  ' 

,  E  = 

0.9911  0.9238 

0.9716  0.8839  0.7459  0.6631  0.7721 

0.1412  0.9555 
0.7691  0.2172 
0.4180  0.6685 

* 
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with  the  initial  gain  matrix  (partitioned  as  in  (2.91)) 


‘  0.9074 

0.4859 

0.5117 

0.5784 

0.7800 

'  Kx 

k2 

0.6664 

0.2697 

0.7345 

0.0293 

0.6229 

k3 

K4  . 

0.4865 

0.5581 

0.0614 

0.8401 

0.2379 

0.3389 

0.4706 

0.3855 

0.3024 

0.9400 

In  simulations  it  was  seen  that  using  equation  (2.108)  directly  to  produce  the  update  of 
K  causes  the  step  size  between  updates  to  be  large  regardless  of  the  size  of  the  matrix  R. 
A  modification  of  this  algorithm  to  control  the  step  size  was  seen  to  be  useful.  This  may  be 
readily  accomplished  since  the  updates  of  the  gain  need  not  be  stabilizing.  An  update  law 
for  the  gain  K  was  chosen  to  be 


Kj+i  =  otNj  4-  (1  —  ot)Kj ,  a  6  [0,  1] 


where  Nj  is  the  solution  of  equation  (2.108)  in  the  jth  iteration. 

Various  choices  of  the  gain  a,  and  the  matrix  R  were  analyzed.  The  variation  of  the  four 
norms,  the  H0 0  norm,  the  FH  norm,  the  Hankel  norm,  and  the  trace  norm  *t  each  iteration, 
where  the  values  R  =  5/  and  a  =  0.6  were  used,  is  shown  in  Figure  2.9.  The  value  of  K  at 
iteration  40  was 


R40  — 


-15.8530 

11.2437 

2.0500 

-2.5727 


2.5021 

-3.1656 

0.0137 

-0.0660 


17.2028 

-13.5988 

-2.5740 

3.3596 


-3.1335 

3.1284 

1.1343 

-1.6122 


-3.9396  ■ 
3.5185 
0.8562 
-0.8960 


In  this  example,  we  can  see  that  beyond  20  iterations  the  various  norms  decrease  exponen¬ 
tially.  In  Figure  2.10  we  see  that  the  algorithm  keeps  finding  gains  that  reduce  the  FH  norm, 
even  though  the  convergence  of  the  gain  K  is  not  smooth.  The  use  of  a  step-size  control  is 
seen  to  be  useful  in  this  case.  The  FH  norm  and  the  H ^  norm,  in  this  example,  are  seen 
to  be  close  not  only  at  the  optimum  but  also  at  each  iteration.  We  can  also  see  that  in  this 
example,  the  solution  is  stabilizing,  and  also  produces  a  stable  controller. 

In  this  example,  the  interval  1  =  [6.00,  25.25],  bounds  the  //«,  norm  which  was  9.44  at 
the  point  in  which  the  first  stabilizing  gain  was  determined.  After  30  iterations,  the  interval 
bounding  the  H «,  norm  was  reduced  to  [.0105,  .0399],  and  its  actual  value  was  .014.  Thus, 
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Figure  2.9:  Log  of  various  norms  at  each  iteration. 

a  significant  reduction  was  made  in  the  H <*>  norm  and  also  the  bounding  interval  I.  The 
fact  that  the  interval  can  be  monitored  implies  that  its  size  and  location  may  be  enough 
to  identify  the  size  of  the  //<*>  norm.  Thus,  the  desired  accuracy  of  the  //«,  norm  may  be 
obtained  without  actual  computation. 

Also  considered  was  the  effect  of  varying  the  order  of  the  controller.  Figure  2.11  shows 
the  FH  norm  trajectories  in  the  computation  process.  As  expected,  the  size  of  the  controller 
affects  the  reduction  of  the  Hoc  norm.  Each  of  the  initial  controllers  chosen  were  unstable 
and  resulted  in  unstable  closed-loop  systems.  After  fifty  iterations,  with  the  controller  of 
order  s  =  1,  the  interval  J  was  [0.0998,  0.5694],  and  the  FH  norm  was  0.1448,  the  norm 
being  0.1254.  For  the  controller  of  second  order,  I  was  reduced  to  [.000171,  .000583],  and 
the  FH  norm  was  .000182,  while  the  Hm  norm  was  .000228.  Finally,  for  the  third  order 
controller,  1  was  [1.80e-6,  1.10e-5],  and  the  FH  and  Hoo  norms  were  computed  to  be  4.38e-6 
and  2.00e-6  respectively.  It  appears  that  the  first-order  controller  converged  with  an  FH 
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Figure  2.10:  Variation  of  norm  of  &Kj  and  the  FH  norm. 

norm  of  approximately  .1448,  while  the  algorithm  produced  controllers  of  order  2  and  3  with 
significantly  smaller  FH  norm. 

2.7.2  Application  to  other  design  problems 

The  disturbance-rejection  paradigm  can  be  used  to  treat  other  control  problems  in  a 
common  framework.  Prominent  examples  are  the  tracking  of  exogenous  inputs,  and  model 
reference  design  [28].  These  are  together  with  the  disturbance-rejection  problem  depicted 
in  Figures  2.12.  As  before,  u  is  the  control  vector,  (  is  the  controlled  output  vector,  w  is 
the  disturbance  vector,  and  y  is  the  measured  output  vector,  while  r  is  a  reference  signal. 
In  the  tracking  problem,  we  also  have  the  exogeneous  input  w.  The  goal  of  the  disturbance 
rejection  problem  is  to  suppress  the  response  in  the  output  £  due  to  the  disturbances  w.  The 
objective  of  the  tracking  problem  is  to  minimize  the  “throughput”  from  the  input  vector 
v  =  [wT  wT\T  to  the  output  e.  Similarly  the  goal  of  the  model  reference  problem  is  to  find 
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Figure  2.11:  FH  norm  variation  for  controllers  of  different  order. 

a  controller  that  reduces  the  effect  of  the  “disturbance”  input  vector  v  =  [rT  wT]T  to  the 
output  vector  e. 

Developing  a  common  design  methodology,  we  first  find  a  common  way  of  representing  the 
closed-loop  system  in  the  tracking  and  model  reference  design  in  a  linear-in-the-parameters 
fashion,  considering  again  the  linear,  time-invariant,  discrete-time,  stochastic  state-space 
plant  (2.88). 

We  consider  additionally  in  the  tracking  problem  the  tracking  model 


/ife+i  =  AiUk  +  B\\bk 

rk  =  Cifik 


and  the  controller 


6+1  =  Kitk  +  [I<2  K3]  ^  "  j  ,  ufc  =  +  [A's  K6)  * 

and  so  for  xe,fc  =  \jiJ.  x[  £j]T,  v*  =  [w%  wl]T,  and  e*  =  r*  -  6  we  have 


(2.112) 


(2.113) 


xe,k+l  —  ACtdXe,k  "h  Ee,dvki  &k  —  DdXe<k 


(2.114) 
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Figure  2.12:  System  structure  for  disturbance  rejection,  model  reference  and  tracking, 
where  ACit  =  At  +  BtKtCu  ECfi  =  Et  +  BtKtEt,  Dt  =  [Cx  —  D  0], 

At  = 


•^1 

0 

0 

A 

O  O 

_ 1 

,  Bt  = 

'  0 

B 

O  O 

_ 1 

,  ct  = 

C\ 

0 

0 

c 

0  ' 
0 

0 

0 

0  _ 

0 

Is. 

0 

0 

Is 

\Bi  0  ‘ 

r  0  0  ' 

■ 

Et  = 

1 

O 

0  0 

_ l 

,  Ft  = 

- 1 

^  0 

0  0 

_ 1 

,  Kt  = 

K6  K5  K< 
I<3  K2  Kl 


For  the  model  reference  problem,  we  adjoin  to  (2.90)  the  model 

fik+i  =  AiUk  +  Bxrk 

m  =  Cifik 

and  the  controller 

6t+i  =  K\  £k  +  [K2  K3] 
and  so  for  xe<k  =  [(*1  x[  £j]T,  and  vk  =  [r^  wJ]T ,  we  have 

Xe,k+ 1  —  Ac^dXt,k  d"  Ec,dVki  &k  =  BdXe<k 


Vk 

rk 


uk  =  K&  +  [I<s  h'e) 


Vk 

rk 


(2.115) 


(2.116) 


(2.117) 


38 


where  i4Cim 


Am  +  BmKmCm,  E, 


c,m 


Em  +  BmKmFm ,  Dm  =  [Ci  —  D  0], 


■^1 

0 

0  ' 

o 

o 

_ 1 

— 

0 

A 

0 

,  Bm 

= 

B  0 

0 

0 

0  . 

0 

Is  J 

:  Bi 

0  ‘ 

0  ' 

Em  = 

0 

E 

II 

•ftf 

0 

F 

5 

0 

0 

.  0 

0 

0  0  0  ' 
:  0  C  0 
.00  It  . 

K6  Ks  k4 

k3  K2  Kx 


1 


All  the  parameters  Kx, . . . ,  of  the  various  dynamic  compensators  are  free  design  param¬ 
eters. 

For  each  of  these  problems, 


Gc(z)  =  Dc(zl  -  AC)~XEC 


(2.118) 


represents  the  closed-loop  transfer  function  from  the  “disturbance”  input  to  the  output, 
e(z)  =  Gc(z)v(z).  We  thus  have  a  common  representation  for  each  of  the  three  problems, 
which  reduce  to  a  disturbance  rejection  problem. 


2.7.3  Examples 

Using  the  same  fifth-order  plant  and  second  order  controllers.  There  are  three  observations, 
two  control  inputs,  two  disturbances,  and  two  outputs.  The  system  was  open-loop  unstable 
and  the  initial  gains,  for  both  the  model  reference  and  the  tracking  problems,  were  chosen 
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at  random  and  were  not  stabilizing.  The  data  defining  the  examples  axe 


A  = 


C  = 
D  = 


0.7090 

0.9167 

0.4492 

0.2074 

0.6020 

0.5190 

0.5971 

0.3805 

0.1958 

0.9716 

0.6911 

0.9911 

0.1412 

0.7691 

0.4180 


0.2174 

0.6322 

0.0208 

0.6609 

0.0931 

0.3851 

0.4729 

0.3592 

0.5790 

0.8839 

0.8366 

0.9238 

0.9555 

0.2172 

0.6685 


0.2156 

0.2471 

0.2714 

0.4611 

0.1519 

0.1583 

0.9797 

0.2248 

0.3055 

0.6527 

0.4585 

0.2312 

0.5431 

0.5976 

0.9319 

0.6518 

0.1310 

0.2305 

0.5466 

0.5970 

0.5064 

0.8039 

0.2023 

0.1848 

0.8710 

0.9427 

0.0715 

0.7459 

0.6631 

0.7721 

0.7631  0.4555  ' 
0.0501  0.5027 
0.6824  0.2716 


0.4218  0.6696 
0.9280  0.7232 
0.3669  0.7510 
0.2272  0.3142 
0.4842  0.3740 


For  the  tracking  problem,  we  considered  the  model 


’  0.0119  -0.7220  0.9915  ' 

‘  0.6242  ' 

'  0.5635  0.6350 

-0.4124  0.4140  0.2435 
-0.1547  0.2075  0.4138 

,  £x  = 

0.1253 

0.1564 

,  Ci- 

0.3515  0.9839 
0.7593  0.2910 

and  used  the  initial  feedback  gain 


-1.8687 

-0.3008 

-1.5063 

1.8896 

-0.7378 

1.9863 

-0.5630 

1.1583 

-1.9086 

-0.3427 

-1.2689 

-1.8124 

1.0980 

-0.2509 

-0.6677 

-0.5334 

-0.7351 

-0.8977 

1.3538 

-1.6057 

0.5989 

-0.1027 

-0.0875 

0.7479 

0.2787 

-1.6202 

0.9261 

-0.2072 

For  the  model  reference  problem,  we  considered  the  model 


'  -0.0313  0.2246  0.1190  ' 

'  0.6242  0.5635  ' 

A\ 

0.0834  -0.0586  0.2339 

0.7635  0.0384  -0.4704 

,£1  = 

0.1253  0.9838 
.  0.1564  0.6350 

,Ci  = 

-0.5186 

0.4124 

-0.0119 


0.4181 

0.2971 

0.1547 


and  used  the  initial  feedback  gain  matrix 


0.5773 

-0.0756 

0.3200 

0.1270 

-0.3971 

-0.1547 

0.9915 

0.7430 

-0.7640 

0.2484 

0.9679 

-0.4181 

-0.7220 

0.2435 

0.6301 

0.0165 

-0.7493 

0.2700 

0.4124 

0.4140 

0.4138 

0.7410 

-0.7173 

-0.6873 

0.5186 

-0.4124 

0.2075 

-0.9343 

40 


Both  initial  gains  were  chosen  at  random.  The  variation  of  the  rour  norms:  the  Hankel  norm, 
the  Hoo  norm,  the  FH  norm,  and  the  trace  norm  for  the  disturbance  rejection  problem  was 
shown  in  Figure  2.9.  Figure  2.13,  and  Figure  2.14,  show  analogous,  results  for  the  tracking 


Figure  2.13:  Log  of  various  norms  for  the  distribution  of  rejection  problem. 

and  model  reference  problems,  respectively.  The  value  of  K  at  iteration  40  for  the  disturbance 

rejection  problem  was  given  earlier.  For  the  tracking  problem  at  iteration  35  the  gain  was 

'  -7.8413  5.3768  -12.1889  1.4176  13.1417  0.3271  0.9358  ' 

_  8.1238  -5.5467  7.7612  -2.1177  -9.7492  -0.1666  -0.9349 

35  1.2912  -0.9435  4.3515  0.9927  -6.2684  0.6571  -0.9840  * 

1.2044  -1.0983  0.9982  0.9183  -2.1879  0.5003  -0.2711  . 

and  the  value  of  K  at  iteration  40  for  the  model  reference  problem  was 

'  2.4721  -1.7562  -15.1818  2.1323  16.6832  -0.1850  -1.8802  " 

K  _  -2.0549  1.6154  10.4600  -2.7596  -12.9371  0.3262  1.8608 

40  ~  -1.8793  0.8583  8.8285  0.1290  -11.7637  1.1118  1.4165  ' 

.  1.3085  -0.0726  -4.4312  0.1457  5.9159  -0.6352  -0.5588  . 

In  this  example,  we  can  see  that  beyond  20  iterations,  the  various  norms  decrease  exponen¬ 
tially.  Figure  2.15  shows  the  convergence  of  the  algorithm  in  each  of  the  three  problems  as 
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1  6  11  16  21  26  31 


~  H 

—  h* 

—  FH 

—  2T 


Figure  2.14:  Log  of  various  norms  at  each  iteration  for  the  model  reference  problem. 

represented  by  the  change  in  Kj.  The  FH  norm  and  the  //<»  norm,  in  this  example,  are  seen 
to  be  close  not  only  at  the  optimum  but  also  at  each  iteration.  We  can  also  see  that  in  the 
example,  the  solutions  are  stabilizing,  and  also  produce  stable  controllers. 

Recall  that  in  the  disturbance- rejection  example,  (see  Table  2.1)  that  the  interval  1  = 


Table  2.1:  Variations  in  AKj  for  the  three  example  problems. 


Problem 

J-initial 

/foo-initial 

X-final 

mfitiMttU'/-''  tViMi 

Dis.  Rej. 

IUB 

9.44 

■llMMlIMU]! 

0.014 

J| 

68.64 

[0.90,  2.23 

0.94 

Mod.  Ref 

(3.74,  12.28] 

6.87 

[0.012,1.13] 

0.014 

(6.00,  25.25],  bounds  the  H0 0  norm  which  was  9.44  at  the  point  in  which  the  first  stabilizing 
gain  was  determined.  After  30  iterations,  the  interval  bounding  the  //<*,  norm  was  reduce 
to  (.0105,  .0399],  and  the  actual  values  was  .014.  Corresponding  results  for  the  two  other 
problems  are  summarized  in  Table  2.1.  Thus,  a  significant  reduction  was  made  in  the 
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100 


—  D.R. 
Tf 

—  M.R. 


Figure  2.15:  Log  of  various  norms  at  each  iteration  for  the  tracking  problem. 

norm  and  also  the  bounding  interval  X,  in  each  of  these  examples. 

The  FH-norm  approach  to  disturbance  rejection  provides  computational  ease  and  a  near* 
optimal  solution  to  the  /foo-norm  minimization  for  controllers  of  bounded  order.  The  ability 
to  consider  a  broad  class  of  problems  makes  this  approach  all  the  more  attractive  for  control 
design.  These  features  are  amply  illustrated  on  the  fifth  order  example.  The  new  Riccati 
equation  based  algorithm  is  computationally  attractive  since  it  takes  advantage  of  devel¬ 
oped  computational  tools  for  the  Riccati  equation  and  eliminates  the  search  for  an  initial 
stabilizing  solution. 
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3 


LOW-ORDER  CONTROLLER  DESIGN  USING 
PROJECTIVE  CONTROLS 

3.1  Time-Domain  Properties  of  Projective  Control 

The  projective  controls  approach  offers  a  method  of  designing  a  low-order  output  feedback 
controller  to  retain  a  subset  of  eigenvalues  and  associated  eigenvectors  of  a  reference  state- 
feedback  system.  The  reference  system  is  typically  obtained  using  an  LQ  approach  or  an 
//oo-norm  approach.  The  obtained  controller  can  be  either  static  or  dynamic,  the  order  being 
determined  in  the  design  process  so  as  to  meet  stated  design  objectives.  Dynamic  projective 
controllers  are  parameterized  by  a  p  x  r  matrix  of  free  parameters,  r  being  the  dimension  of 
the  measured  output  vector,  p  being  the  order  of  the  controller.  When  transient  performance 
is  the  issue,  an  LQ  approach  is  typically  used  to  determine  the  reference  system,  and  the 
retained  eigenstructure  is  chosen  to  retain  the  dominant  dynamics  of  the  reference  system. 
The  design  freedom  available  in  the  free  parameters  is  then  used  to  shape  the  residual 
dynamics.  When  disturbance  rejection  is  the  issue,  an  i/oo-norm  approach  is  employed  and 
the  design  freedom  in  the  available  free  parameters  is  used  to  further  improve  disturbance 
rejection. 

In  this  section  time-domain  properties  of  projective  controls  are  reviewed  emphasizing  in 
particular  a  convenient  parameterization  of  projective  controllers.  The  remaining  sections 
expand  the  projective  controls  methodology  and  provide  design  tools  to  achieve  transient 
performance  and  disturbance  rejection  using  low-order  controllers.  Section  3.2  concentrates 
on  the  problem  of  shaping  the  residual  dynamics,  Section  3.3  presents  the  frequency-domain 
properties  of  projective  controls  and  their  impact  on  the  disturbance-rejection  problem, 
Section  3.4  develops  the  FH  norm  approach  to  solve  the  disturbance-rejection  problem  us¬ 
ing  projective  controllers,  and  Section  3.5  introduces  a  convenient  similarity  transformation 
which  reduces  the  system  representation  to  a  linear  in  the  free  parameter  form  and  extends 
the  design  to  decentralized  systems. 

The  projective  controls  method  [29],  [30]  is  a  method  for  designing  low-order  controllers 
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for  higher-order  systems  based  on  retaining  a  subset  of  the  poles  and  the  associated  eigen- 
structure  of  a  reference  system.  The  reference  system  is  determined  by  a  state-feedback 
controller  which  is  chosen  for  its  desirable  properties.  Many  algorithms  exist  for  designing 
state-feedback  controllers;  thus  projective  controls  approach  is  suitable  for  use  in  combina¬ 
tion  with  many  types  of  synthesis  methods.  Moreover,  once  the  state-feedback  controller  is 
determined,  the  projective  controller  is  easily  computed.  In  particular,  this  reference  system 
can  be  written  in  the  form 

Gr(s)  =  Grl(s)Gr2(s),  (3.1) 

while  the  closed- loop  projective  controls  system  has  been  shown  to  reduce  to 

G,(s)  =  Grl(s)Gp2(s).  (3.2) 

The  G>i(s)  is  called  the  retained  subsystem  while  Gp2(s)  is  called  the  residual  subsystem. 
The  order  of  the  retained  subsystem  is  determined  by  the  class  of  controller  chosen.  Three 
classes  of  controllers  are  considered  here:  static,  proper  and  strictly  proper  controllers.  For 
a  static  projective  controller  the  residual  dynamics  are  completely  determined  and  stability 
and  performance  of  the  non-retained  dynamics  is  not  guaranteed.  In  the  case  of  dynamic 
controllers,  the  projective  controllers  are  parameterized  by  free  parameters.  These  may  be 
used  to  achieve  stability  and  improve  the  performance  of  the  residual  subsystem.  In  the 
remainder  of  this  section,  we  state  the  basic  properties  of  projective  controllers  and  develop 
controller  parameterizations. 

3.1.1  Static  controllers 

Suppose  a  state- feedback  controller  u  =  K0x  is  applied  to  the  system  (2.1)  and  yields  the 
reference  system 

Gr{s)  =  (H  +  EK0)(sI  -  F)~XG ,  (3.3) 

where  F  =  A  +  BKa.  The  eigenstructure  of  the  reference  system  is  FX  =  X A  where  A 
is  a  diagonal  matrix  of  the  eigenvalues  of  F,  A(F)  and  X  is  a  matrix  of  the  associated 
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eigenvectors.  The  reference  system  can  be  determined  using  any  of  the  appropriate  state- 
feedback  design  methodologies.  One  common  design  approach  is  LQ  optimization.  It  has  the 
desirable  properties  of  producing  controllers  which  axe  guaranteed  to  be  stabilizing  through 
the  solution  of  the  algebraic  Riccati  equation.  In  particular,  the  stabilizing  controller  which 
minimizes  ||G(s)||2  is  given  by 

u  =  K2x,  K2  =  -BtM2,  (3.4) 

where  M2  >  0  is  the  solution  of  the  algebraic  Riccati  equation 

AtM2  +  M2A  -  M2BBtM2  +  HtH  =  0.  (3.5) 

For  details,  see  for  example  [31]. 

A  stablizing  controller  which  guarantees  ||G(s)||oo  <  7  is  given  by 

«  =  KocX,  tf=o  =  -BtM00  (3.6) 

providing  there  exists  Moo  >  0  which  satisfies  the  algebraic  Riccati  equation 

AtM00  +  Moo  A  -  M00BBtM00  +  ijM00GGrM00  +  HTH  =  0.  (3.7) 

For  details,  see  for  example  [1]. 

Consider  now  a  static  controller  which  retain  the  r  reference  eigenvalues  Ar  and  associated 
eigenvectors  Xr ,  where  r  is  the  number  of  measured  outputs. 


Theorem  3.1.  If  Ar  is  observable  from  C,  then  the  static  output-feedback  controller  C(s) 
retains  [Ar,  XT]  if  and  only  if 


C(s)  =  Dc 

(3.8) 

where 

Dc  =  K0N0, 

(3.9) 

N0  =  Xr(CXr)-\ 

(3.10) 

Proof.  Let  the  feedback  Dc  retains  [Ar,  -Vr].  We  thus  must  have 

AcXr  =  (A  +  BDcC)Xr  =  XrAr. 

(3.11) 
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Also 


FXr  =  {A  +  BK0)Xr  =  XrAr. 


(3.12) 


Subtracting  the  two  equations  yields 

BDcCXr  =  BK0Xr.  (3.13) 

Since  Ar  is  observable  from  C,  CXT  is  invertible  and  (3.13)  is  satisfied  by  Dc  given  by  (3.9), 
(3.10).  Conversely,  let  Dc  be  given  by  (3.9),  (3.10).  Then 

AcXr  =  AXr  +  BK0Xr  =  FXr  =  XrA  r.  (3.14) 

□ 

Theorem  3.2.  Given  the  control  law  (3.8)-(3.10),  the  eigenvalues  of  the  closed-loop  system 
are 

\c  =  Ar  U  \{Ar)y  (3.15) 

where 

Ar±YT(In-N0C)AY  (3.16) 

and  Y  satisfies  CY  =  0  and  YTY  =  /n_r. 

Proof.  Let  T  be  given  by 

T  —  \x  Y\  T~l  —  U  —  (C^r) 

1  -\Xr  Y\,  1  -  y  -  YT(In  _  NoC)  ■  (3.17) 

Note  that  U  and  V  exist  provided  that  CXr  is  invertible  which  is  guaranteed  by  the  observ¬ 
ability  of  Ar.  Thus  T  is  invertible  since  U  and  V  exist. 

•  « 

T~'A‘T=  [  o  A.  j  (318) 

with 

Ar  =  YT(In  -  N0C)AY  (3.19) 

□ 
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3.1.2  Proper  Controllers 


The  following  result  identifies  the  class  of  pth-order  controllers  that  retain  r+p  eigenvalues 
and  the  associated  eigenvectors  of  the  reference  system. 

Theorem  3.3.  The  set  of  p^-order  proper  controllers  which  retain  [AP,  XT\  and  [Ap,  Xp]  is 
given  by 

C(s)  =  Cc(sl  -  Ac)~l  Bc  +  Dc  (3.20) 


with  {Ac,  Bc ,  Cc,  Dc)  parameterized  by  P0  €  !Rpxr  as 


Ac  =  A  p  +  P0CFB0 

Bc  =  P0CF(N0  -  B0P0)  -  ApP0 

Cc  =  KoB0 

Dc  =  Ko(N0  —  B0P0) 

and  B0  =  (/„  -  N0C)XP. 

Proof.  From 

AeXr  =  xX 


follows 


'  A  +  BDcC  BCc  ' 

'  Xp  XT' 

'  XP  Xr 

'  Ap  o' 

BcC  Ac 

Wp  Wr 

Wp  Wr 

0  Ar 

AcWv  +  BcCXv  =  Wp  Ap 
AcWr  +  BcCXr  =  Wr  Ar 

BCcWp  +  {A  +  BDcC)Xp  =  XPAP  =  (A  +  BK0)XP 
BCeWr  +  {A  +  BDcC)Xr  =  Xr\T  =  {A  +  BK0)Xr 


'Ac  Be' 

$ 

$ 
_ i 

'  Wp Ap 

Wr\r  ' 

Cc  Dc 

l  CXp  CXr  j 

K0XP 

K0Xr 

thus, 


Ac  Bc 

'  WpAp  Wr  Ar  ' 

Wp  Wr 

Cc  Dc 

K0Xp  K0Xr 
>  ~  « 

CXp  CXr 

Define  L  =  W~lWr;  then  (3.24)  becomes 


Ac  Be 

'  Wp Ap 

WpLAr  ' 

WPL  ' 

Cc  Dc 

K0XP 

KoXr 

[CXP 

CXr 

(3.21) 


(3.22) 


(3.23) 


(3.24) 
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or 


‘Ac  Bc  _  Wp  0  Ap  L\r  7P  L  l"1  W;1  0  ' 

Cc  Dc  ~  0  Im  KaXp  KaXr  CXP  CXT  0  IT 


(3.25) 


Note  that  Wp  represents  a  state-space  transformation  of  the  controller  and  thus  Wp  is  arbi¬ 
trary.  It  follows  that 


Ip  L  I"'  _  IP  +  Lbr'CXp  -LA-1' 
CXP  CXr  ~  -A -XCXP  A-1 


with 

A  =  CXr  -  CXPL. 


Defining  P0  =  L(CXr  —  CXPL )  1,  produces 


A-^iCXr^ilr  +  CXM 


and 

Iv  L  l*1  _  [  IP  +  P0CXp  -P0 

CXp  CXr  [-(CXr^CX^  +  P^X,,)  (CXr)-1(/r  +  C'XpP0)  / 

Now  setting  Wp  =  ( Ip  -f  PaCXp),  the  identity  in  (3.24)  becomes 

Ae  Be  _  {Ip  +  PoCXp)  Ap  P0CXT\T  Ip  -P0 

Cc  £>CJ“[  K0Xp  KaXr  -{CXT)-XCXp  (CXr^ilr  +  CX^o) 

or 

’  Ae  Bc  Ap  +  P0C F(XP  -  N0CXP)  P0CF{NaCXp  -  Xp)P0  +  P0CFNa  -  A pP0  ’ 
,Cc  Dc  I<0(XP  -  N0CXP )  K0(N0CXP  -  Xp)P0  +  K0N0  ’ 

which  finally  results  in 

Ac  Bc  =  +  P°CFBo  PoCF{No  -  B0P0)  -  A pP0  ' 

,Cc  Dc\  K0B0  K0(N0  -  B0P0) 

□ 

Theorem  3.4.  Given  the  control  law  (3.20)-(3.21 ),  the  eigenvalues  of  the  closed-loop  system 
are 

Ac  =  Ap  U  Ar  U  A(Ar)  (3.26) 
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where 


Ar  =  Ar  +  B0P0AY. 


(3.27) 


Proof.  Consider 


and  define 


which  gives 


A,  = 


A  ■+■  BDeC  BCc 
BeC  Ae 


r_  X,  Xr  Y 

1  -  I,  +  PaCXp  P0CXT  0  ’ 


T-1  =  f  ?  1  =  (CXr)-lC(In  +  XpP0C )  ~{CXT)-'CXP 
V  YT  +  Yt(B0P0  -  No)C  -Y^Bo 


- PoC 


It  can  now  be  verified  that 


Ap  0  * 

T~lAcT  —  0  Ar  * 

0  0  Ar 


Ar  =  YT(In  +  (B0P0  -  N0)C)AY  =  Ar  +  YT B0P0AY. 


3.1.3  Strictly  proper  controllers 

Consider  finally  the  pth-order  strictly  proper  controller  which  retain  the  p  reference  eigen¬ 
values  Ap  and  associated  eigenvectors  Xp. 

Theorem  3.5.  The  set  of  pth-order  strictly  proper  controllers  which  retain  [Ap,  Xp]  is  given 
by 


C(s)  =  Cc{sl  -  Ac)~lBc 


(3.28) 


and  parameterized  by  P0  €  2RrXp  where 


Ac  =  Ap  —  P0CXp 
Be  =  P0 
Cc  —  K0Xp. 


(3.29) 
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Proof.  From 


we  have 


A 

BCc 

*,1- 

'  V 

BcC 

Ac  . 

l 

AeWp  +  BeCXp  =  WPAP 


or 

Ac  =  Wp\pWpl  -  BcCXpWpl 
=  Wp(Ap  -  W~lBcCXp)W~l. 

Defining  P0  =  W~lBc,  relation  (3.31)  reduces  to 


with 


From  (3.30)  also  follows 


Ae  =  Wp{Ap-  P0CXp)W;' 

Bc  =  WpP0. 

BCcWp  +  AXP  =  Xp\p 


(3.30) 


(3.31) 


(3.32) 


(3.33) 


or 

BCcWp  +  AX  =  (A  +  BK0)XP, 


which  is  satisfied  by 


CeWp  =  K0XP 


or 

Ce  =  K0XPW;\  (3.34) 

Note  that  Wp  represents  a  state-space  transformation  of  the  controller  and  thus  Wp  is  arbi¬ 
trary.  Choosing  Wp  =  Ip,  reduces  (3.32)-(3.34)  to  (3.29). 

Theorem  3.0.  Given  the  control  law  (3.28)-(3.29),  the  eigenvalues  of  the  closed-loop  system 
are 

Ac  =  A„  U  A(Ar)  (3.35) 

where 

Art  A-  XpPoC.  (3.36) 
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Proof.  Consider 


Ac  = 


A  BCc 
BcC  Ae 


and  introduce  the  transformation 

T  = 

Then 

and  so 


In' 

f-1  - 

'  0 

b 

b 

0 

9  X  — 

.  b 

-Xp\ 

T~XA,T  = 


Ap  * 


0  Ar 
Ar  —  A  —  XVP„C. 


3.1.4  Example 
Consider  the  system  defined  by 


■  0 

1 

-2 

1  ' 

’  0  ' 

-2 

-1 

0 

1 

,  B  = 

1 

0 

1 

0 

1 

0 

1 

-2 

-1 

-1  . 

.  1 . 

A  = 

Q  =  diag  {100,0,100,0},  R  -  1, 


with 


and 


C  =  [l  0  0  0], 


Spec  {A}  =  {-1.53  ±  ;'2.18, 0.53  ±;0.92} 


Spec  {F}  =  {-3.57  ±;4.09, -1.30, -0.56}. 

It  can  easily  be  determined  in  this  problem  that  static  projective  controls  will  not  stabilize 
the  system.  Thus,  a  first-order  dynamic  controller  is  sought.  Since  r  =  1,  p  =  1,  there  is  only 
one  free  design  parameter.  It  effect  on  the  residual  dynamics  can  be  observed  by  considering 
the  root  locus  for  the  residual  system  (note  that  here  C  =  [/,  0],  so  YT  =  [0  Jr]) 


xr  =  (Ar  +  BQpAii)xr 
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where 


'  -24.46 

46.93 

-22.46  ' 

-9.10  ‘ 

0.78 

0.44 

0.78 

,  Bo  = 

0.07 

21.59 

-48.18 

22.59 

8.94 

Al2  =  [1  -2  1]. 

Omitting  the  details,  it  is  determined  in  this  particular  problem  that  the  stabilizing  values 
of  p  are  in  the  interval  [-2.575,  -2.595].  The  controller  parameters  are 

H  =  -1.3-0.31p,  D  =  0.85p  +  0.31p2 
Nd  =  13.49,  Kd  =  -35.84  -  13.49p. 

Taking 

p  =  -2.5875 

the  controller  becomes 

H  =  -0.50,  D  =  0.17 
Nd  =  13.49,  Kd  =  0.49 

and  the  spectrum  of  the  closed  loop  system  becomes 

Spec  {Ace}  =  {-0.56,-1.30,  -0.20, -0.22  ±;1.44}. 

Here,  the  first  two  eigenvalues  have  been  retained  from  the  reference  dynamics,  and  the  last 
three  placed  by  solving  the  auxiliary  pole-placement  problem. 

3.2  Shaping  the  Residual  Dynamics 

Consider  presently  that  C  =  [Ir  0]  as  in  the  previous  example,  and  note  that  the  residual 
dynamics  (3.32)  can  be  associated  with  an  auxiliary  static  output- feedback  control  problem 
for  a  system  of  (n  —  r)th-order  with  p  input  and  q  outputs,  where  q  =  rank  Ai2.  It  is  well 
known  [32]  that  such  an  output  pole-placement  problem  has  a  solution  for  almost  all  Ar ,  B0 
and  Ai2,  and  almost  all  desired  spectra  Aj  if  n  —  r  <  p  +  g,  i.e.,  if 

p  >  n  —  r  —  q. 

This  implies,  in  particular,  that  when  A\2  is  maximum  rank,  q  =  r,  the  pole  placement 
problem  can  be  solved  for  almost  all  problems  using  an  (n  —  2r)th-order  controller;  this  is 
of  lower  order  than  the  Luenberger  (minimum  order)  observer.  We  present  a  solution  to  the 


53 


pole- placement  problem  in  a  novel  way  that  utilizes  the  full  available  freedom,  as  opposed 
to  earlier  procedures  where  P  is  frequently  (for  ease  of  calculation)  restricted  to  be  of  unity 
rank  [33]. 

Let 

Ti  =  [Ux  U2 }  (3.37) 

where  Ux  €  fl<n-r>xr,  U2  €  #«-')*(—*>  satisfy 


AuUx  =  / 


Then 


Define 


Ax2U2  —  0. 


At  =  T~1AT'Tx  =  Tf'ArTx  +  Tr'B0P[I  0]. 


TxlArTx  = 


Dn  Di  2 

D2x  D22 


,  Tr'Bo  = 


Ei 

E2 


with  Du  6  RrXr,  D2X  €  rt(n-2r)",  €  fTx»\  Then 

^i  = 


^11  +  ^1^  D  X2 

Dji  E2P  D22 


Now  introduce  the  second  transformation 


T2  = 


/r  0 

L  I 


T-l  — 
,  i  2  — 


/r  0 

-L  I 


,  L  €  fl(2n-r)*r. 


It  can  then  be  shown  that 

A2  =  T21AxT2  =  T2lTr1AeTiT2  =  T-lAreT 


Dxx  +  Dx2L  +  EXP  DX2 
— R(L)  -+■  ( E2  —  LEX )  D22  —  LDX2 


where 


R(L)  =  LDX  i  —  D22L  +  LDx2L  —  D2x. 


(3.38  a) 
(3.386) 

(3.39) 

(3.40) 

(3.41) 

(3.42) 

(3.43) 

(3.44) 
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Now  suppose  n  —  2r  >  p;  this  implies  that  a  solution  to  the  pole-placement  problem  almost 
always  exists.  It  also  allows  a  non-unity  rank  solution  to  the  pole-placement  problem  to  be 
determined.  To  this  end,  decompose  E2  —  LE\  as 

E2  -  LE\  =  [M\  Mt]  (3.45) 

where  Mi  €  #(n-2r)x(n_2r)  and  detMi  ^  0.  Decompose  P  and  E\  as 

P  =  [PiP,],  £,  =  [£?£{)  (3.46) 


with  P,  €  Pj  e  Rfr-***)*',  £•  e  and  £f  6  P'xl>-,+!r>. 


Theorem  3.7.  Let  L  place  the  pole  of  D22  —  LDX2  at  AX  and  let  P2  place  the  poles  of 
Act  —  BeiP  at  A2  where 


Ad  =  Du  +  DX2L  +  E\M;lR{L) 

(3.47) 

Bc i  =  E{M;'M2  -  Ex. 

(3.48) 

Then  if 

p,  =  Mc'(mi)  -  m2p2) 

(3.49) 

we  have 

A(Are)  =  Ai  U  A2. 

(3.50) 

Proof.  From  3.43,  using  (3.45)  and  (3.46)  follows 

.  Du  +  DX2L  +  E*Pi  +  E\P2  DX2 

A2  ~  -R{L)  +  M1P1  +  M2P2  Dx2  -  LDU  ' 

(3.51) 

Choosing  P\  to  satisfy  (3.49)  for  given  L  and  P2  produces 

[  Dn  +  Di2L  +  ElMixR{L)-{ElMixM2- E\)P2  Dx2 
A2  “  0  Du-  LD12  ■ 

□ 
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3.2.1  Example 

To  illustrate  the  above  pole-placement  procedure  consider  problem  of  placing  the  poles  of 


at  A d  =  {—3,  —4,  —5}.  For  this  problem 


Follows 


D21  =  [-4  -  3],  D22  =  -2,  G2  =  [0], 

B,  =  °  l  ,  ft  =  |10). 

Dn  —  =  —2  —  [£i  /,]  j  =  —2  —  ■ 


Suppose  the  eigenvalue  of  D22  —  LDi2  is  selected  to  be  —4  €  Aj.  In  view  of  above  choose 

i2  =  2 

and  without  loss  of  generality,  let  £\  =  0.  For  this  L  we  get 
R(L)  =  LD\\  —  D22L  ■+■  LD\2L  —  D\2 

=  Mil®  j]-2[«.2]  +  Ml[  ®  1  [/  2]  -  [-4  -3] 

»  •  i 

which  produces 

R{L)  =  [4  3]. 


We  now  want  to  satisfy 


R{L)  =  (B2  -  LBX)P; 


[43]  =  ([10]-[02]f°  J 
=  [Pi  P,]  -  2[P3  P.J, 


Pi  P, 
P3  P. 
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and  hence, 


[Pi  Pi\  =  {4  3]  +  2[/>3  Pa). 


Since  here  7\  =  /,  then  E  =  TXXB  =  B ,  and  so  Ex  =  Bx,  E2  =  Thus  we  solve  the  pole 
placement  problem 

A(Z?n  +  D^L  +  B\K)  =  Ajj  —  {—3,  —5}. 


Since 


D\i  +  DtfL  +  B\P 


this  demands  that 


Which  in  turn  results  in 


o  o 

1 

0 

+ 

■  0  ■ 
0 

k 

* 

■  0 
0 

1 

2 

+ 

0 

.  p3 

[0  2]  + 


0  0  Pi 

0  1  P3 


0 

Pa 


0 

P3 


Pi 

Pa 


P3  =  -15 

P4  =  -8. 


Px  =  -26 

Pi  =  -8. 


And  so  the  gain  matrices 


P  = 


26  17 
15  8.  ’ 


L  =  [0  21 


place  the  poles  of  Are  at  {—3,  —4,  —5}. 


3.3  Frequency  Properties  of  Projective  Controllers 

In  the  previous  sections,  attention  was  focussed  on  improving  the  closed-loop  performance 
by  retaining  properties  of  a  state- feedback  controlled  system  with  a  low-order  projective 
controller;  thus,  time-domain  properties  of  projective  controls  were  exploited.  Disturbance- 
rejection  properties  Me  typically  judged  according  to  frequency-domain  measures  such  as  the 
i7oo  norm.  Expressions  have  therefore  been  developed  which  relate  the  frequency- domain 
properties  of  a  system  with  a  projective  controller  to  the  frequency-domain  properties  of  a 
system  with  a  state- feed  back  controller. 

In  treating  frequency  domain  properties  via  transfer  functions  it  is  often  useful  to  use 
the  compact  notation  of  the  transfer  function  while  retaining  the  state-space  representation 
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for  computational  purposes.  We  do  so  here  and  introduce  the  following  notation  for  this 
purpose: 


Definition  3.1.  Given  the  state-space  representation  of  the  LTI  system 


x(t)  —  Ax(t)  +  Bw(t) 
z(t)  =  Cx(t)  +  Dw(t) 


(3.52) 


where  x  €  IR”  is  the  state,  w  6  2R"1  is  the  input,  z  6  fC  is  the  output,  the  transfer  function 
of  the  system  shall  be  denoted  by  the  packed  representation 


4f§-  &C(*I-A)-'B  +  D. 


(3.53) 


Thus,  through  the  use  of  the  expression  (3.53),  the  transfer  function  of  the  system  is 
represented  in  terms  of  a  state-space  representation  using  a  compact  notation. 


r>  ^  Ai  Bx  n  .  .  a  A2  B2 

&i(s)  — -  n  »  t»2(s)  n  ’ 


Ci\Dx 


C-i  d2 


(3.54) 


If  the  two  systems  Gi(s)  and  G2(s)  are  cascaded  together  as  in  Figure  3.1,  the  resulting 


Figure  3.1:  Cascade  connection. 


system  can  be  represented  as 

A2  B2Ci  B2D\ 

G2(s)G1(s)  =  0  A\  B\  .  (3.55) 

C2  D2C\  D2D\ 

If  the  two  systems  are  connected  in  parallel  as  in  Figure  3.2,  the  resulting  system  can  be 
represented  as 

'  Ai  0  Bi  ' 

Gi(s)  +  G2(s)  =  0  A2  B2  .  (3.56) 

C\  C2  D\  +  D2 
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Figure  3.2:  Parallel  connection. 


Figure  3.3:  Feedback  connection. 


Note  that  representations  (3.55)  and  (3.56)  are  not  necessarily  minimal.  Consider  finally  the 
feedback  configuration  of  Figure  3.3.  Let  the  plant  have  the  state-space  representation 

x  —  Ax  +  Bu  +  Gw 

z  =  Hx  +  Eu  (3.57) 

y  =  Cx  +  Dw 


where  x  6  IFT*  is  the  state,  w  €  IR"*  is  the  disturbance  input,  u  G  IFT  is  the  controlled  input, 
z  €  Si*  is  the  controlled  output,  y  6  IFC*  is  the  measured  output.  The  transfer  function  P(s) 
is  characterized  by 


*(*)  1  _ 


=  P(s) 


(3.58) 


Then 


If  the  system  is  controlled  by 


’  A  G  B  1 
P(s)=  HOE 
.  C  D  0 


C(s)4 


(3.59) 

(3.60) 


so  that 


<i(j)  =  C(s)y(a), 


(3.61) 


then  the  closed  loop  feedback  system  represented  on  Figure  3.2  is  given  by 


A  -j*  BDcC  BCc 

G  +  BDCD  ' 

G(s)  = 

BcC  Ac 

BCD 

[  H  +  EDeC  ECe 

EDCD  J 

(3.62) 


We  can  now  state  the  following  results  for  transfer  function  properties  of  projective 
controllers. 


Theorem  3.8.  Define  the  error  between  the  static  projective  system  and  the  reference 
system  as 


E(s)  4  Gr(s)  -  Gp(s). 


(3.63) 


Then 


E(s) 


F 

B 

Ar 

Gr 

H  +  EK0 

E 

K0Y 

0 

-  Ei(s)  ■  E2{s) 


where  Gr  =  YT{In  -  N0C)G. 

Proof.  Recall  here  that  Ar  is  given  by  (3.36).  By  definition,  E(s)  is  given  by 


F 

0 

G  ' 

£(s)  = 

0 

Ac 

-G 

[h  +  EKo 

H  +  EDcC 

o 

Applying  the  state  space  transformation 


T0t 


In 

-xr 

-Y  ' 

T~l  = 

'  In 

0 

In  ' 

u 

0 

X-r 

Y 

?  0 

0 

V 

produces 


E(s)  = 


F 

0 

-BK0Y 

0  ' 

0 

Ar 

UAY 

-UG 

0 

0 

Ar 

-VG 

H  +  EK0 

0 

-EKJY 

0  J 

Removing  the  unobservable  states  yields 


F 

-BK0Y 

0  ' 

E(s)  = 

0 

Ar 

-VG 

L  H  +  EK0 

-EK0Y 

0 

F 

B  ' 

Ar 

VG  ' 

H  +  EK0 

E 

I<0Y 

0 

(3.64) 


(3.65) 


(3.66) 


(3.67) 


(3.68) 

□ 
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Theorem  3.9.  Define  the  error  between  the  proper  projective  system  and  the  reference 
systems  as  E(s)  =  Gr(s )  —  Gp(s).  Then 


E(s)  = 


F 

B  ' 

Ar 

Gr  +  YTB0P0CG 

H  +  EK0 

E 

K0Y 

0 

=  E1(3)-E2(s;P0).  (3.69) 


Proof.  Recall  that  Ar  is  given  in  (3.27).  By  definition  now 

E(s)  = 


F 

0 

0 

-G  ' 

0 

A  +  BDcC 

BCe 

G 

0 

BeC 

Ac 

0 

1  H  +  EK0 

H  +  EDcC 

ECc 

0  J 

Applying  the  state  space  transformation 


T0  = 


In  -Xp  -XT  -Y 

0  Xp  XT  Y 

0  Ip  +  P0CXp  P0CXT  0 


T"1  = 

X  O 


In  In  0 

0  -P0C  Ip 

0  (CXr)-lC(In  +  XpP0C)  -( CXT)-'CXP 

L  o  yt  +  yt(b0p0-n0)c  -ytb0 


yields 


E(s)  = 


F 

0 

0 

-BK0Y 

0 

0 

Ap 

0 

* 

♦ 

0 

0 

Ar 

* 

♦ 

0 

0 

0 

Ar 

Gr  +  YTBoP0CG 

[h  +  ek0 

0 

0 

-EK0Y 

0  J 

Removing  the  unobservable  states  yields 


E(s)  = 

F 

0 

-BK0Y 

Ar 

0 

Gr  +  YTB0P0G 

[  H  +  EK0 

-EK0Y 

0 

which  is  equivalent  to 

E(s)  = 


F 

B  ' 

H  +  EK0 

E 

Ar 

Gr  +  YTB0P0CG  ' 

K0Y 

0 

(3.70) 


(3.71) 


(3.72) 


(3.73) 


(3.74) 


(3.75) 


Theorem  3.10.  Define  the  error  between  the  strictly  proper  projective  system  and  the 


reference  system  as  E(s)  =  Gr(s)  —  Gp(s).  Then 

E(s)  = 


F 

B  ' 

'  Ar 

G 

H  +  EK0 

E 

Ko 

0 

(3.76) 
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Proof.  By  definition,  E(s)  is  now  given  by 

E(s)  = 


F 

0 

0 

-G  ' 

0 

A 

BCc 

G 

0 

BcC 

Ac 

0 

[h  +  ek0 

H 

ECe 

0 

Applying  the  state  space  transformation 


T0  = 


yields 


/.  -A 

i 

'In 

In 

0  ' 

0  /„ 

II 

is 

0 

0 

b 

L  o  h 

o  J 

0 

In 

-xp\ 

F 

0  -BK0 

0  ■ 

0 

PX 

0 

E{s)  = 

0 

0  A 

Lr 

G 

• 

L  H  +  EKo  0  -EK0 

o  J 

Removing  the  unobservable  states  yields 


F 

-BK0 

0  ’ 

■ 

0 

Ar 

G 

=  " 

[H  +  EK0 

-EK0 

0  ^ 

■ 

F 

B  ' 

Ar  I 

G' 

H  +  EK0 

E 

Ko 

0 

(3.77) 


(3.78) 


(3.79) 


3.4  FH-Norm  Optimization  of  Projective  Systems 

Previous  development  has  shown  that,  when  dynamic  projective  controls  are  used,  the 
error  transfer  function  in  all  cases  reduces  to 


E(s)  =  E1(s)  ■  E2(s), 


where  i?i(s)  is  independent  of  the  free  controller  parameter  while  E2(s)  depends  on  P0. 
Because  ||£(.s)||  <  ||F1(s)||  •  ||.£2(.s)||  and  |j£i(s)||  is  constant,  it  is  a  natural  idea  is  to  choose 
Po  to  reduce  ||i?2(s)||.  This,  however,  is  not  necessary  and  one  may  attempt  to  reduce 
||£(s)||  which  represents  a  frequency  weighted  optimization  problem  with  respect  to  P0.  In 
either  case,  an  auxiliary  minimization  problem  is  solved  to  determine  the  free  parameters 
of  the  dynamic  projective  controllers  in  the  disturbance- rejection  problem.  The  auxiliary 
minimization  problem  is  to  find  P0  to  solve 


Po  —  arg  nain  ||T(s;  P„)||, 

•  o 


(3.80) 
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where  T(s\  P0)  is  some  appropriate  transfer  function  which  is  dependent  upon  Pa,  and  |[  •  || 
is  an  appropriate  norm.  The  transfer  functions  that  we  will  consider  here  are  E2(s)  given 
in  (3.64)  or  (3.69),  and  the  norm  will  be  the  FH  norm  as  the  computationally  feasible 
alternative.  The  alternative  approach  where  T(s)  =  E(s)  is  also  of  interest  and  has  the 
advantage  that  it  takes  into  account  the  frequency  weighting  implied  by  Ei(s)  in  (3.64)  or 
(3.69).  Finally,  we  may  choose 

T(s)  =  G{s)  (3.81) 


in  which  case  the  intent  is  not  to  reduce  the  error,  but  instead  directly  reduces  ||G(s)||  subject 
to  constraint  on  controller  structure.  In  this  section  we  choose  to  select  the  free  parameters 
of  the  system  Pa  to  satisfy 

Pa  =  arg  nun  ||£2(s;  P0)||fh,  (3-82) 

•  o 

while  the  alternative  approach  of  reducing  ||G(s)||jrj/  is  considered  in  the  next  section. 

For  the  case  of  strictly  proper  controllers  E2(s)  is  given  by 


E2(s) 


Ar 

G  ' 

f  Ar 

Br 

K0 

0 

[  Cr 

0 

(3.83) 


where  Ar  is  given  by  (3.36).  The  problem  then  is  to  minimize  over  P0 


J{P0)=  Tr  PtQt  (3.84) 

subject  to  the  two  Lyapunov  equations 

ArPr  +  PrATr  +  BrBj  =  0  (3.85) 

AjQr  +  QrAr  +  CjCr  =  0 

which  define  the  controllability  and  observability  grammians  of  (3.83).  The  necessary  con¬ 
ditions  for  a  minimum  then  consists  of  (3.85)  and 

ArLr  +  LrAj  +  PT  =0 

AjMr  +  MrAr  +  Qr  =  0  (3.86) 

Xj{QrLr  +  MrPr)CT  =  0 

where  M.  and  Lr  are  Lagrange  multipliers  for  the  constraints  (3.85). 
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(3.87) 


The  gradient  of  J  with  respect  to  P0  can  be  computed  for  arbitrary  P0  as 

=  -2  Xl(Q,L,  +  M,P,)Ct 

where  Pr,  Qr,  Lr  and  Mr  solve  the  Lyapunov  equations  (3.86). 

Thus,  a  feasible  directions  algorithm  can  be  implemented  by  iteratively  solving 

<3-88) 

for  the  optimal  PQ. 

For  proper  controllers,  we  will  assume  for  simplicity  that  C  =  [/  0],  so  Y  = 
the  expression  for  E2(s)  reduces  to 


Et(s)  =  K2(sl  -  Ar)~x(VG  +  BoPoGi)  (3.89) 

where  Ar  is  given  by  (3.27),  K2  =  K0Y,  V  is  defined  in  (3.17),  B0  =  YTB0  and  G\  =  CG. 

The  necessary  conditions  then  take  the  form 

ATrQr  +  QrAr  +  K\K2  =  0 

ArPr  +  PrAr  +  (VG  +  B0P0G1)(VG  +  B0P0G,)T 

ArLr  +  LrAr  +  Pr  =  0  1  ’ 

AjMr  +  MrAr  +  Q2  —  0 

and 

=  2  Bl[QTMT  +  LrPr\ATl2  +  2BqMt(VG  +  B0P0Gt)Gj  =  0.  (3.91) 

C/i  o 

The  structure  of  (3.91)  allows  the  use  of  the  steepest  descent  method,  with  P0  adjusted 
via  (3.88),  as  well  as  the  use  of  the  Riccati  equation  based  algorithm  when  {GiGj )_1  exists. 
The  next  iterate  for  Pq  is  then  given  by 


Pi*'  =  -(MM'rB0)-‘{BZ(Q‘rM‘  +  L\P;)At„  +  BZM‘VGGl\(G,Gl) 


T\- 1 


(3.92) 


3.5  Disturbance  Rejection  using  the  FH  Norm  and  Projective 
Controllers 


3.5.1  Problem  formulation 

In  some  cases,  it  may  be  important  to  consider  directly  disturbance  rejection  with  respect 
to  G(s),  where  G(s)  is  the  closed-loop  transfer  function  of  the  system  using  proper  or  strictly 
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proper  projective  controllers.  It  is,  however,  observed  from  the  paxameterization  of  the 
projective  controllers  that  the  closed-loop  system  is  a  non-linear  (quadratic)  function  of 
the  free  parameter  matrix  Pq.  Thus  to  simplify  the  computational  issues,  and  reduce  in  the 
design  phase  the  system  representation  to  simplest  form,  we  seek  in  this  section  a  reduction  to 
LIFP  (linear-in-the-free-parameters)  representation  of  the  closed  loop  system.  We  will  do  so 
in  the  decentralized  setting  where  a  number  of  decentralized  low-order  projective  controllers 
is  used  to  retain  by  joint  action  a  selected  invariant  subspace.  In  the  decentralized  case, 
however,  even  the  residual  dynamics  exhibits  a  nonlinear  dependence  on  the  free  design 
parameters  Ply . . . ,  Pq,  where  q  is  the  number  of  decentralized  control  channels  and  Pi  is  the 
free  parameter  matrix  parameterizing  the  z'-th  controller.  Thus,  in  the  decentralized  case, 
it  is  even  more  significant  to  reduce  the  system  to  the  LIFP  representation.  We  therefore 
develop  the  LIFP  representation  here  for  the  decentralized  control  problem,  which  reduces 
to  the  centralized  problem  when  q  =  1. 

Consider  the  decentralized  system  of  Figure  3.4.  The  state  space  description  of  this 
system  can  be  written  as  follows: 


x  =  Ax  -)-  B1U2  -I-  B2U2  +  Gw 
yi  =  Cix 
y2  =  C2x 

yc  =  Hx. 


(3.93) 


where  x  €  iR" ,  «i,«2  €  IRM ,  s/i^e-W,  yecSP,  and  welP?.  Let  the  dynamic  controllers  have 
the  structure 


L  =  +  Diyi 

Uj  NjiZi  KdiVit  i  —  1,2. 

where  €  JRP ,  i  =  1,2,  and  define  the  extended  system  as 


(3.94) 


xe  —  AeXe  +  BuUi  -f  f?2eu2  +  Gew 
yu  =  Cuxe 
V2e  =  C2exe 

!/ee  =  HeXe 


(3.95) 


65 


Figure  3.4:  Decentralized  system. 


where 


'  A 

0 

0  ' 

’  Bx  ' 

’  b2- 

=s 

D\C\ 

Hx 

0 

7  = 

0 

,  &2e  = 

0 

D2C2 

0 

Hi  . 

0 

0 

r  Ci  0 

01 

n 

Cl  ( 

ot 

'le 


Ge  = 


0/0 
G 
0 
0 


0  0/ 


(3.96) 


,He  =  [H  0  0]. 


The  goal  is  to  determine  {Hi,  Du  Ndi,  Kdi)  and  {i/2,  D2,Nd2,  Kd2]  to  achieve  certain  per¬ 
formance  and  disturbance  rejection  goals. 

It  has  been  shown  [34]  that  if 

u  =  —K0x  (3.97) 


is  a  stable  feedback  control  producing  the  closed-loop  system 

x  =  Fx  -(-  Gw 
yc  =  Hx 


(3.98) 


66 


with  F  having  the  Jordan  decomposition 

F[Z'+r  *«]  =  [*r+,  xj  *’+’  ^  ,  Xrt,  6  £"<'«),  (3.99) 

then  there  exist  dynamic  controllers  of  the  form  (3.94)  such  that  the  resulting  closed-loop 
system  retains  all  eigenvalues  in  Ar+P  together  with  the  associated  invariant  spaces.  In  fact, 
the  entire  family  of  such  controllers  has  been  parameterized  [34]  as  follows: 

Hi  =  W^W-1,  Hi  =  A*  +  PiF^Boi,  *  =  1,2 

Di  =  WnDi,  Di  =  PiF*  -  HiPi,  *  =  1,2 

(3.100) 

Kdi  =  H„  —  NdiPi,  *  =  1,2 

Ndi  =  NdiW~\  Ndi  =  K\B'q,  i  =  1,2. 

Here  P,,  t  =  1,2  are  free  parameter  matrices  of  dimension  p  x  r,  the  presence  of  Wp,  implies 
the  invariance  to  similarity  transformations,  while  Ap,  Ar  are  partitions  of  the  Jordan  form 
Ar+P  and  P(2,  B'0l  F},  Kti,  Ndi  and  K'2,i  =  1,2  are  known  quantities  determined  directly 
by  the  reference  solution  P  and  its  eigenvectors,  assuming  for  each  i  that  the  system  has 
transformed  into  the  representation  where  =  \Ir  0].  For  details  see  [34]. 

If  transient  performance  is  of  primary  concern,  then  the  reference  state-feedback  solution 
can  be  determined  by  solving  an  LQ  optimization  problem,  and  projective  controls  will 
then  retain  in  the  closed-loop  system  the  dominant  poles  of  the  reference  solution  that 
define  acceptable  transient  response.  The  free  parameters  are  then  determined  by  solving 
an  auxiliary  problem  to  shape  the  residual  dynamics. 

If  disturbance  rejection  and  ‘ransient  response  are  of  concern,  then  the  reference  solution 
can  be  determined  to  minimize  the  Hoo  norm.  The  Poo-optimal  state-feedback  control  is 
given  again  by  (3.6)  where  M  >  0  is  the  solution  of  the  ARE  (3.7)  with  B  =  [Bi  B2],  and  7 
is  the  minimal  value  for  which  M  >  0  solving  (3.6)  exists.  The  use  of  (3.6)  guarantees  here 

IIGcMIU  =  -  F)-'G|I~  <  1  (3.101) 

with  both  control  channels  using  state-feedback  controls.  Projective  controls  will  now  fix 
the  dominant  poles  and  associated  eigenvectors  of  the  system  at  locations  determined  by 
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the  reference  solution,  while  the  free  parameters  Px,  P2  are  to  be  used  to  shape  the  residual 
dynamics  to  achieve  disturbance  rejection.  To  simplify  the  disturbance  rejection  problem 
in  applying  the  FH-norm  minimization  approach,  the  transformation  developed  in  [34]  that 
reduces  the  closed-loop  to  a  linear-in-the-free-parameters  (LIFP)  form  will  be  applied. 

3.5.2  Transformation  to  the  LIFP  form 

Assuming,  without  loss  of  generality,  that  =  /,  Wp2  =  /,  the  closed-loop  system 
becomes 

xe  =  Acexe  +  Gew  (3.102) 

1 /«  =  Hexey  (3.103) 

with 

Ad  — BiNdi  —B2Nod2 

Ace  =  (PiK1  -  HXPX)CX  A pi  +  PiF12BI  0  (3.104) 

.  (Af?  -  ff2p,)c,  0  ap2  +  p2f;2&i  . 

where 

Ad  =  Ac  4-  B\Nd\P\  +  B2 Nd2 P2 ,  Ac  =  A  —  B\Kg\C\  —  B2K,2C2. 

Now  apply  the  transformation  x3  =  Txe  where 

'  /n  0  0  1  r  In  0  0' 

T  =  PXCX  Ip  0  ,  f'1  =  -PXCX  Ip  0  . 

P~iC2  0  Ip 2  _  _  —P2C2  0  Ip 2 

The  system  (3.103)  becomes 

X3  =  AceX3  + 

Vce  —  B-eict 

where 

Ace  =  T~lAceT,  Ge=T-lGe,  He  =  HeT. 

The  expression  for  Ace  can  thus  be  derived  to  be 

Ac  —BxNdX  B2Nd2 
Ace  —  P\EX  Ap  +  PXGXX  P\GX2 

.  P2B2  ^2^21  Ap2  +  P2G22 

=  Ae  +  BXeP2CXe  +  B2eP2C2e 


(3.105) 

(3.106) 

(3.107) 

(3.108) 

(3.109) 
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where 


Ae  = 

‘  v4c 

0 

-BiNdi 

Ap 

—B2Nd2 

0 

Bu  = 

‘  0  ‘ 
/p. 

B2e  = 

'  0  ‘ 
0 

0 

0 

AP2 

0 

.1,2. 

Cu  —  [Ei  G\\  Gu],  Cit  =  [E2  G21  G22] 


with 

Ex  =  F}C\  —  C\Ae,  E2  =  FJC2  -  C2Ac 
Gn  —  Ei2Bq  +  Ci  Bi  Nji  ,  G\2  =  C1B2N42 

G21  =  C2BiNdu  G22  =  F?2Bi  +  C2B2Nd2 

while 


‘  In 

0  0  ' 

'  G  ' 

=  f~lGe  = 

-P1C1 

Ip  0 

0 

—  P2C2 

Kf- 

0 

0 

'  G  ' 

=  -P1C1G 
—P2C2G 

=  G3-  BuPiCiG-  B2eP2C2G 


He  =  //eT  =  He. 


(3.110) 


(3.111) 


(3.112) 


(3.113) 


Thus,  when  the  similarity  transformation  is  applied  to  the  system,  the  expression  derived  for 
/4ce,  (5e,  and  He  all  exhibit  a  linear  dependence  on  the  free  parameter  matrices  Pi  and  P2. 
(He  is  in  fact  independent  of  the  free  parameter  matrices.)  This  linear  dependence  can  now 
be  utilized  to  determine  suitable  Pi  and  P2  (and  thus  the  dynamic  controllers)  to  achieve 
disturbance  rejection  by  minimizing  the  FH  norm. 


3.5.3  FH-norm  minimization 


This  minimization  now  reduces  to  the  minimization  of  Je  = 


following  constraints: 


AZQ.  +  Q.A'.  +  SJH.  =  0 
A„P,  +  PJl  +  G'OJ  =  0. 


Trace  PeQe  subject  to  the 


(3.114) 
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By  defining  the  Lagrange  multipliers,  Le  =  Lj,  Me  =  Mj ,  the  problem  can  again  be  reduced 
to  an  unconstrained  minimization  and  since  Aee ,  Ge ,  and  He  are  all  linear  functions  of  the 
free  parameters;  only  minor  changes  are  introduced  in  the  usual  necessary  conditions.  These 
can  now  be  written  as  follows: 

dJ/dPe  =  AjeMe  +  MM  +  Qe  =  0 

dJ/dQe  =  AeLe  +  LeAl  +  Pe  =  0 

dJ/dLe  =  +  QM  +  HjHe  =  0 

(3.115) 

dJ/dMe  =  AcePe  +  peAl  +  GeGJ  =  o 

dJ/dPx  =  2Bl(MePe  +  -  2BlMeGeGTCl[ 

dJ/dP2  =  2Bl(MePe  +  QeLe)Cl-2BlMeGeGTCf. 

The  feasible  direction  algorithm  can  now  be  applied.  Initially,  the  free  parameter  ma¬ 
trices,  Pi  and  P2,  are  set  to  zero,  (although  arbitrary  values  can  be  used).  If  the  resulting 
closed-loop  system  matrix,  A„  given  by  (3.104)  has  unstable  eigenvalues,  Je  is  not  defined. 
In  this  case,  an  embedding  parameter,  p,  is  chosen  such  that 


p  >  MaXi(i2eA,(A)), 


(3.116) 


and  Ace  modified  to  Ace  —  pi.  If  the  resulting  Aee  is  stable,  the  embedding  parameter  is 
then  zero.  This  leads  to  a  modified  extension  Jta  with  an  expanded  region  of  definition 
encompassing  the  initial  P\,  P2. 

In  the  feasible  direction  algorithm,  the  first  four  equations  in  (3.115)  are  solved  for  A/e, 
Le,  Qe  and  Pe.  These  are  then  used  in  the  last  two  equations  to  calculate  a  gradient  direction 
for  the  next  iterate  of  Pi  and  P2,  with 


P'+1  =  Pi-sdJ/dPi 
P'+i  =  P2-sdJ/dP2, 


(3.117) 


where  s  is  the  step  size  solving  the  one  dimensional  minimization  problem 


am,a*tSJ-(p'-hTFl'P,-hm) 


(3.118) 
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thus  guaranteeing  convergence  to  a  local  minimum.  Using  the  embedding  parameter  method, 
the  maximal  eigenvalue  of  Ace  can  be  successively  moved  towards  the  imaginary  axis.  The 
parameter  s  can  then  be  decreased  and  ultimately  when  the  system  is  stabilized  s  can  be 
set  to  zero  resulting  in  the  minimization  of  the  original  criterion  Je.  However,  it  may  not 
be  possible  to  move  all  unstable  eigenvalues  into  the  left-half  plane  without  simultaneously 
forcing  previously  stable  eigenvalues  into  the  right-half  plane.  If  this  situation  occurs,  the 
order  of  the  dynamic  controller  must  be  increased  to  provide  additional  design  freedom 
needed  to  stablize  the  system.  Expanding  controllers  if  necessary  is  simple  in  view  of  the  way 
controllers  are  parameterized  (see  [34])  and  expanded' free  parameter  matrices  can  utilize  the 
latest  iterates  of  Pi  and  P 2  to  simply  continue  the  combined  stabilization  and  optimization 
process.  This  resulting  algorithm  applicable  to  an  arbitrary  number  of  controllers  can  be 
summarized  as  follows: 

1)  Initialize  P/  =,  t  =  1, . . . ,  k. 

2)  Evaluate  the  resulting  closed-loop  system  matrix  Aeei  based  on  the  current  iterative  value 

of  P,-,  i  =  1, . . . ,  k.  If  Ac.  is  stable,  proceed  to  step  5. 

3)  Choose  an  embedding  parameter,  p,  such  that  p  >  Max,(PeA,(A)). 

4)  Solve  the  associated  minimization  problem  recursively  until  p  can  be  set  equal  to  zero. 

(If  Act  cannot  be  stabilized,  increase  the  order  of  the  dynamic  controllers  to  be  used 

and  start  the  algorithm  over.) 

5)  Solve  for  Pe,  Qe,  Le  and  Me  from  the  necessary  conditions  for  a  minimum  Trace  PeQe. 

6)  Use  the  partial  derivative  equations  with  respect  to  the  free  parameter  matrices  to 

calculate  gradient  directions. 

7)  Set  P/  +  1  =  A P,  +  P/  where  A P<  =  - sdJ/dPi ,  t  =  1,. . . ,  k. 

8)  Repeat  until  Pi,  i  =  1,. ..  ,k  converge  to  their  optimal  values. 
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9)  Use  calculated  Pi,  i  =  1  to  determine  controller  parameters  based  on  the  param¬ 

eterization  given  by  (3.100)  to  complete  the  controller  design. 

It  is  noted  that  in  view  of  (3. 109)-(3.1 13)  the  last  two  necessary  conditions  in  (3.115)  are 
linear  in  Pi,  P2.  However,  they  represent  coupled  Sylvester  equations,  and  so  do  not  reduce 
to  a  computationally  attractive  Riccati-based  algorithm.  In  the  centralized  case  however, 
one  can  use  the  Riccati-based  algorithm  provided  ( CGGTCT)~l  exits. 


3.5.4  Example 


In  order  to  illustrate  the  approach,  consider  a  seventh-order  system  with  two  decentralized 
dynamic  controllers  to  be  designed  so  as  to  minimize  the  effects  of  a  disturbance  input  on  the 
regulated  outputs.  A  system  of  the  form  (3.93)  will  be  used,  characterized  by  the  following 
matrices: 


-2 

1 

0 

0  - 

-1 

-2 

-3 

1 

0 

0 

-2 

-3  - 

-2 

0  - 

1 

0 

0 

1 

-3  - 

1 

-1 

0 

1 

0  - 

2 

0 

2  - 

-1 

-1  - 

2 

-1 

0  - 

-3 

0  - 

2 

1  0 

0  0 

0 

0  0  1 

0  1 

0  0 

0 

0  0 

-1 

0  0 

1 

0  0  0' 

0 

1  0 

0 

10  0 

1 

0  ' 

‘  0  ' 

■  0  ■ 

1 

1 

0 

0 

-1 

-1 

1 

0 

0 

0 

Bi  = 

0 

b2  = 

0 

1 

0 

0 

0 

1 

1 

0 

0 

-2 

-4 

0 

1 

G 


'  0 
0 
0 
1 
1 
1 
0 


1  0  0  0  0  0  0 
0  1  0  0  0  0  0 


Q  =  diag  {100,10,100,0,0,0,0},  Rn  =  R„  =  1. 
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The  open- loop  system  is  unstable,  with  the  spectrum, 

A(A)  =  {-2.80  ±;2.41, -4.48, -3.71,. 83  - .68,-1.26}. 

The  reference  system  (here  an  LQ  solution,  i.e.,  7  — ►  00)  is  characterized  by  the  optimal 
spectrum, 

A  (F)  =  {-10.09,  -1.62  ±  jl.63, -1.15,  -4.5,  -3.10  ±  j.87}. 

Since  in  this  problem  ri  =  r2  =  2,  two  modes  of  the  reference  solution  can  be  retained 
with  static  projective  controls.  In  addition,  by  using  two  first-order  dynamic  controllers,  one 
additional  mode  can  be  retained.  The  dominant  modes  are  chosen  for  retention;  thus, 

_  -1.62  +  >1.63  0 

Ar-[  0  —1.62  —  jl.63 

The  initial  choices  for  Pi  and  P2  are 

Pi  =  10  0),  P2  =  [0  0] 

producing  the  closed-loop  spectrum, 

A(Ace)  =  {-3.65  ±  j'2.16,  -3.89,  .36,  -1.62  ±  j'1.64,  -.92,  -1.15,  -1.15}. 

Note  that  this  choice  of  Pt  and  P2  fails  to  stabilize  the  resulting  closed  loop  system.  Con¬ 
sequently,  the  embedding  parameter  method  must  be  used  initially  until  a  stable  Ace  is 
achieved,  or  it  is  determined  that  the  order  of  the  dynamic  controllers  must  be  increased. 
For  the  example  at  hand,  first-order  controllers  did  produce  a  stable  system;  thus,  the  order 
did  not  need  to  be  increased. 

The  feasible  direction  algorithm  is  then  employed  to  yield  the  optimum  parameters  for 
Pi  and  P2  for  disturbance  minimization.  These  optimal  values  are  found  to  be 

Pi  =  (-2.41  0.71] 

P2  =  [-3.65  1.58] 

with  an  optimal  value  of  the  cost  criterion  of 

J  =  Trace  PeQe  =  1.4302?-2. 


AP  =  [-1.15]. 
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(Notice  that  for  the  initial  choice,  J  =  oo,  since  the  system  was  unstable.)  The  closed  loop 
spectrum,  Ace,  produced  by  the  free  parameter  matrices  is  now 

A  (Ace)  =  {-5.77  ±  3.3  6j,  -.58  ±  1.72;,  -4.26,  -3.42,  -1.62  ±  1.63;,  -1.15}. 

Once  Pi  and  P2  are  determined,  the  controller  parameters  can  then  be  determined  from 
(3.100)  to  be 

Hi 
Di 
I<dx 
Ndi 

thus  completing  the  design. 

3.6  A  design  example 

We  finally  present  a  realistic  design  example  to  illustrate  the  design  procedures  developed 
in  these  two  sections.  The  structure  considered  is  a  45  foot  lattice-type,  light-weight  (5  lbs.), 
flexible  beam  with  fixed  base  and  free  tip  shown  in  Figure  3.5.  The  system  is  modeled  by  a 
40th  order  state  space  model. 

The  control  u  £  1R2  consists  of  torques  applied  at  the  base  of  the  structure  about  the  x 
and  y  axes.  The  disturbance  w  £  R2  is  generated  by  an  x  —  y  translation  applied  to  the 
base  where  the  x-axis  is  taken  to  be  the  axis  of  the  cruciform.  Measurements  of  the  system 
y  €  1R8  are  obtained  from  an  x  —  y  axis  gyro  and  accelerometer  sensors  located  at  the  tip 
and  base  of  the  structure.  The  controlled  output  z  £  IR*  is  the  position  measurement  at  the 
tip  and  base  of  the  structure.  The  model  parameters  can  be  found  in  Figure  3.6  to  3.8  [35]. 
This  example  haw  also  been  studied  in  [36]  and  [37]. 

The  system  considered  in  this  example  consists  of  the  x-axis  dynamics  of  the  complete 
system.  The  inputs  and  outputs  were  decentralized  after  a  Generalized  Hessenberg  analysis 
[37]  of  the  system.  The  resulting  systems  are  described  in  Table  3.1.  For  more  details  see 
(35],  (37]. 

The  12th  order  model  of  the  x-axis  dynamics  was  obtained  by  performing  a  balanced 
reduction  on  the  original  system  using  only  the  x-axis  inputs  and  outputs.  The  eigenvalues 


=  -1.93, 

=  [-5.48  -4.58], 
=  [-3.43  -  1.95], 
=  -0.95 


Hi  =  -7.92 
Di  =  [-25.17  17.05] 
Kd  2  =  [-34.17  20.48] 
Nd2  =  -8.87, 
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Table  3.1:  Modes  of  the  Cruciform  Model. 


Real 

Imaginary 

Frequency 

Damping 

-4.2471e-03 

±8.4941e-01 

8.4942e-01 

5.0000e-03 

-3.4723e-02 

±7.0339e+00 

7.0340e+00 

4.9365e-03 

-3.0800e-02 

±7.7296e+00 

7.7297e+00 

3.9846e-03 

-1.9863e-01 

±1.0458e+01 

1.0460e+01 

1.8989e-02 

-5.1863e-01 

±2.5925e+01 

2.5930e+01 

2.0001e-02 

-8.2976e-01 

±4.6092e+01 

4.6100e+01 

1.7999e-02 

of  the  resulting  model  are  found  in  Table  3.1  and  show  typical  flexible  structure  properties, 
i.e.,  lightly  damped  and  closely  packed  low  frequency  modes.  The  y- axis  dynamics  were 
treated  similarly  but  are  not  shown  here. 

Note  that  model  reduction  was  used  only  to  remove  very  weakly  controllable  and  observ¬ 
able  modes.  This  is  done  to  avoid  neglecting  modes  which  may  be  important  in  the  design 
of  the  controller  since  the  projective  controls  method  allows  on?  to  use  a  high  order  model 
without  requiring  a  high  order  controller. 

The  cruciform  model  is  decentralized  intoz-axis  and  y-axis  systems  as  shown  in  Table  3.2. 


Table  3.2:  GHR  Decentralized  Model  Results. 


Model 

Inputs 

Outputs 

x-axis 

Ul,W2 

Z2,zs,yi,y4,ys,yu 

y-axis 

u2iwl 

*1,24^2,2/5^7,1/10 

3.0.1  Design  of  the  controller. 

A  projective  controller  is  now  designed  to  achieve  disturbance  attenuation  for  the  cruciform 
system.  From  Figure  3.9  it  can  be  seen  that  ;he  nominal  system  has  disturbance  attenuation 
of  7  =  — 20dB.  In  this  example,  the  disturbance  attenuation  will  be  improved  to  7  =  — 40dB 
using  a  low-order,  robust  controller  designed  using  the  projective  controls  method. 

A  reference  a  state  feedback  controlled  system  was  determined  first.  The  eigenvalues  of 
the  resulting  closed  loop  system,  A (F)  are  given  in  Table  3.3.  The  frequency  response  of  the 


75 


Table  3.3:  Modes  of  the  Reference  System. 


Real 

Imaginary 

Frequency 

Damping 

a 

-1.0856e-01 

±8.5272e-01 

8.5960e-01 

1.2629e-01 

b 

-3.4723e-02 

±7.0339e+00 

7.0340e+00 

4.9365e-03 

c 

-3.0801e-02 

±7.7296e+00 

7.7297e+00 

3.9848e-03 

d 

-1.9902e-01 

±1.0458e+ 01 

1.0460e+01 

1.9026e-02 

e 

-5.1870e-01 

±2.5925e+01 

2.5930e+01 

2.0004e-02 

f 

-8.2977e-01 

±4.6092e+01 

4.6100e+01 

1.7999e-02 

closed-loop  system  in  Figure  3.10  shows  the  disturbance  attenuation  to  be  7  =  — 40dB.  The 
gain  margins  are  (0,  00)  and  phase  margins  are  ±90°.  Thus,  this  state  feedback  forms  an 
acceptable  reference  system  for  the  projective  controls  method. 

Static  projective  controls  excited  the  higher  frequency  models  and  so  second  order  ( p  —  2) 
dynamic  projective  controller  was  considered.  In  the  design  of  the  dynamic  strictly  proper 
projective  controller,  there  are  two  main  design  freedoms:  the  selection  of  the  retained  modes 
[A p,  Xp)  and  the  selection  of  the  design  parameter  P0.  The  retained  modes  [Ap,  Xp]  are  chosen 
to  retain  disturbance  attenuation  and  robustness  properties  as  much  as  possible.  The  mode 
a  is  retained  in  order  to  preserve  the  damping  of  this  mode  for  disturbance  attenuation. 
Thus,  Ap  =  {a}. 

To  select  P0,  the  approach  of  Section  3.4  was  applied.  Using  a  gradient  method,  the 
Frobenius-Hankel  norm  of  E 2  was  minimized.  The  frequency  response  of  the  dynamic  con¬ 
troller  associated  with  this  choice  of  D0  is  given  in  Figure  3.11. 

3.6.2  Evaluation  of  Design 

The  final  step  was  to  evaluate  the  design  by  applying  the  controller  to  the  full  system. 
The  spectrum  of  the  resulting  closed  loop  system  is  shown  in  Table  3.4.  The  disturbance 
attenuation  of  the  full  system  is  7  =  -40dB  as  seen  in  Fig.  3.13.  Thus,  the  disturbance 
attenuation  goals  of  the  design  have  been  met  using  a  second  order  controller.  The  gain 
margins  are  [0,  \QdB]  and  phase  margins  are  ±70°  which  approach  the  stability  margins 
of  the  state  feedback  system.  However,  if  these  results  are  not  satisfactory,  a  higher  order 
controller  could  be  considered. 
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To  demonstrate  the  disturbance  attenuation  achieved  by  this  design  in  the  time  domain, 
the  time  response  of  the  system  to  a  disturbance  impulse  is  computed.  The  open  loop 
response  is  given  in  Figure  3.14.  Note  the  low  damping  of  the  low  frequency  mode.  For  the 
system  controlled  by  the  design  given  above,  the  response  is  given  in  Figure  3.15.  In  this 
case,  the  damping  on  the  low  frequency  mode  has  increased  dramatically. 

A  controller  was  also  designed  for  the  y-axis  dynamics  of  the  system  in  a  similar  manner. 
The  resulting  closed  loop  system  with  decentralized  controls  was  seen  to  be  stable  and 
retain  the  desired  disturbance  attenuation  properties.  Thus,  the  disturbance  attenuation 
of  an  flexible  system  has  been  improved  using  two  second  order,  decentralized  controllers 
designed  by  the  method  of  this  paper. 
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Figure  3.5:  The  Cruciform  Structure. 
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Figure  3.8:  Model  Output  Parameters. 


Figure  3.9:  Frequency  Response  of  the  Open-Loop  System. 
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Figure  3.10:  Frequency  Response  of  the  Reference  System. 
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Figure  3.11:  Frequency  Response  of  the  Compensator. 


Figure  3.12:  Frequency  Response  of  the  Closed-Loop  System. 
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Figure  3.13:  Time  Response  of  the  Open- Loop  System. 
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Figure  3.14:  Time  Response  of  the  Closed- Loop  System. 
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4  Hoc  DISTURBANCE  REJECTION  VIA  THE  AL¬ 
GEBRAIC  RICCATI  EQUATION 

4.1  Introduction 

Sections  2  and  3  have  concentrated  on  results  useful  in  developing  methodologies  for  low- 
order  controller  design.  For  example,  the  projective  controls  approach  allows  a  convenient 
parameterization  of  low-order  controllers  which  retain  some  spectral  characteristics  of  a 
desirable  reference  controller,  and  the  FH-norm  minimization  approach  provides  a  means 
of  determining  these  free  parameters  to  guarantee-disturbance  rejection  for  the  closed-loop 
system.  The  determination  of  the  free  parameters  of  a  low-order  controller  so  as  to  directly 
minimize  or  bound  the  H ^  norm  of  the  closed-loop  system  is  an  open  issue.  While  necessary 
conditions  can  be  derived,  see  for  example  [38,39,40,41],  the  existence  issue  is  open,  and 
moreover,  convergence  of  available  algorithms  is  not  guaranteed  even  if  a  solution  exists. 

A  great  deal  of  research  has  been  conducted  on  H^  control  design  and  the  related  issue 
of  robust  control.  For  a  survey  of  these  two  areas,  see  [42]  and  its  references.  In  the  last 
few  years,  the  connection  between  Hoo  control  and  the  algebraic  Riccati  equation  (ARE)  has 
been  established.  See,  for  example,  [43],  [44],  [2],  [45],  [46],  [47],  [48],  [49],  and  [1]. 

This  section  concentrates  on  the  ARE  based  methodology  for  controller  design  by  which 
minimizing,  or  bounding,  the  Hoo  norm  of  the  closed-loop  system  is  accomplished.  The 
methodology  is  useful  for  deriving  three  classes  of  controllers:  (i)  state-feedback  controllers; 
(ii)  full-order  observer-based  output-feedback  controllers;  and  (iii)  decentralized  controllers 
comprising  a  full-order  observer  of  the  plant  in  each  control  channel.  The  state-feedback  and 
centralized  output-feedback  control  laws  derived  by  this  methodology  have  been  developed 
in  previous  work,  such  as  [48],  [1],  [47],  and  [46].  However,  the  decentralized  control  laws  are 
new,  and  represent  a  novel  approach  to  //oo-norm- bounding  decentralized  control  design. 

For  convenience,  we  restate  the  standard  disturbance-rejection  problem  to  be  addressed. 
Consider  a  linear,  time-invariant  plant  of  the  form 

x  =  Ax  +  Bu  +  Gw0,  (4.1a) 
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y  =  Cx  +  w,  (4.16) 

1  =  (**)•  (41c) 

where  x  is  the  state  of  the  plant,  u  is  the  control  input,  y  is  a  measured  output,  z  is  an 

output  to  be  regulated,  and  w0  and  wi  are  squa,re-integrable  disturbances.  Note  that  (4.1) 

is  essentially  the  same  as  (2.1),  with  D  =  0. 

Given  any  control  input  u  to  the  plant  (4.1),  define  the  cost  functional 

J(u)  =  sup  {tt-tt  :  wo  €  L2[0,oo),u;o  ^  ol . 

Note  that  the  measurement  (4.1b),  and  hence  the  measurement  noise  w,  is  not  considered 
in  this  definition.  Therefore,  the  cost  J(u)  is  associated  with  open-loop  controls  or  state- 
feedback  controls.  In  the  case  where  ti  is  a  state- feedback  control,  J(u)  is  the  norm  of 
the  closed-loop  transfer-function  matrix  from  wq  to  z.  Define  the  optimal  cost  as 

Qoo  =  inf{J(u) :  ti  6  Z,2[0,oo)}.  (1?) 

The  following  theorem  from  [48]  gives  a  means  of  determining  a^,  and  also  establishes  iat 
there  exists  a  state-feedback  control  law  which  achieves  any  i/oo-norm  bound  larger  than 

®  oo- 


Theorem  4.1.  For  the  plant  (4.1)  with  ( A,B )  stabilizable,  and  ( A,H )  detectable,  the 
bound 


Q<x>  <  Q 

holds  if  and  only  if 

AtX  +  XA+^?XGGtX  -XBBtX  +  HtH  =  0,  (4.3) 

or 

with  X  >  0  and  Aa  =  A  —  BBTX  -I-  a ~2GGT  X  Hurwitz.  If  so,  the  state-feedback  control 
law 

u  =  —BtXx  (4.4) 

stabilizes  the  plant,  and  gives  a  closed-loop  transfer-function  matrix 

T(s)  =  (jjrx)w  ~A  +  BBtX)-'G 
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from  w0  to  z  satisfying  ||T’| <  a. 

If  the  control  u  for  plant  (4.1)  must  be  generated  by  a  controller  that  uses  only  the 
measurement  y  given  by  (4.1b),  then  the  relevant  cost  functional  is 

J0(u)  =  sup{if|;u,e  €  £2(0,00),^  =  [toj  wT]  ±  o| . 

The  infimal  value  of  the  output-feedback  cost  Jq(u)  is  generically  greater  than  a defined  in 
(4.2).  The  following  theorem  from  [48]  or  [1]  gives  a  means  of  determining  this  greatest  lower 
bound,  and  also  gives  an  output-feedback  control  law  which  guarantees  any  given  H0 o-norm 
bound  achievable  by  output  feedback. 

Theorem  4.2.  In  the  plant  (4.1),  assume  ( A,B )  stabilizable,  ( A,C )  detectable,  ( A,G ) 
stabilizable,  and  ( A ,  H)  detectable.  Then  there  exists  a  stabilizing  controller  such  that  the 
closed-loop  transfer-function  matrix  T(s)  from  we  to  z  satisfies  HTHoo  <  a  if  and  only  if 


AtX  +  XA  +  \xGGtX  -  XBBtX  +  HtH  =  0  (4.3) 

a2  v 

with  X  >  0  and  Aa  =  A  —  BBT X  +  a~iGGTX  Hurwitz, 

AY  +  YAt  +  ~YHtHY  -  YCtCY  +  GGT  =  0  (4.5) 

with  Y  >  0  and  A  -  YCTC  +  a-2YHTH  Hurwitz,  and 

<rm~{YX}<a2.  (4.6) 

If  so,  then  the  output- feed  back  control  law 

£  =  (A  +  ^ GGtX  -  BBtX  -  LC)i  +  Ly ,  (4.7a) 

«  =  -BTXi  (4.76) 

with 

L  =  (I  -  a~2YX)~xYCT  (4.8) 
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stabilizes  the  plant  and  gives  a  closed-loop  transfer-function  matrix  from  we  to  z  satisfying 
imu  <  a. 


If  a  decentralized  control  structure  :s  imposed  or  desired  for  a  given  problem,  then  the 
result  given  in  Theorem  4.2  cannot  be  used.  A  great  deal  of  attention  has  been  paid  to  the 
problem  of  decentralized  control  design;  see,  for  example,  [50],  [51],  [52],  [38],  [53],  [54],  [55], 
and  [56].  Unlike  previous  work,  the  decentralized  design  procedure  derived  here  addresses 
the  issue  of  H «>  suboptimal  control  in  a  decentralized  setting,  and  results  in  observer- based 
designs  that  rely  on  a  known  state-feedback  7/oo-norm- bounding  control.  The  observer  struc¬ 
ture  assumed  for  the  controllers  allows  the  derivation  of  two  design  equations  for  the  decen¬ 
tralized  control  law:  One  of  these  is  the  standard  state-feedback  design  equation;  the 
other  is  a  Riccati-like  algebraic  equation  (RLAE). 

The  decentralized-control  version  of  the  disturbance-rejection  problem  is  formulated  and 
a  solution  derived  in  Section  4.5.  The  approach  is  based  on  a  fundamental  lemma  described 
next,  and  the  spirit  of  the  approach  is  then  illustrated  on  the  centralized  control  problem 
where  the  result  in  Theorem  4.2  is  rederived. 

4.2  The  Key  Lemma 

The  following  lemma  establishes  a  sufficient  condition,  in  the  form  of  an  “algebraic  Riccati 
inequality,”  for  a  given  system  to  be  stable  and  have  a  particular  //oo-norm  bound.  This 
condition  provides  the  basis  for  all  the  control  laws  derived  in  the  remainder  of  Section  4,  as 
well  as  those  derived  in  Section  5.  The  lemma  is  a  simple  extension  of  Lemma  1  of  [57]. 

Lemma  4.1.  Let  T(s)  =  H(sl  —  F)~lG,  with  (F,  H)  a  detectable  pair.  If  there  exist  a  real 
matrix  X  >  0  and  a  positive  scalar  7  such  that 

FtX  +  XF+  ^ XGGtX  +  HtH  <  0,  (4.9) 

then  F  is  Hurwitz,  and  T(s)  satisfies 

imu  <  7.  (4.10) 
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Proof.  Suppose  (4.9)  holds,  with  X  >  0.  To  show  that  F  is  Hurwitz,  let  v  ^  0  satisfy 

Fv  =  \v. 

Multiply  (4.9)  on  the  left  by  vm  and  on  the  right  by  v  to  obtain 

2Re(\)vmXv  +  ~vmXGGTXv  +  v*HTHv  <  0.  (4.11) 

i 

Now,  2J?e(A)u* Xv  <  0  since  all  other  terms  on  the  left-hand  side  of  (4.11)  are  non-negative. 
If  Re(\)v*Xv  <  0,  then  v'Xv  >  0  and  fle(A)  <  0.  If,  on  the  other  hand,  Re(X)v’Xv  =  0, 
then  all  terms  in  (4.11)  must  be  zero.  Therefore,  the  eigenvector  v  of  F  is  in  the  null  space 
of  H.  Since  ( F,H )  is  detectable,  the  corresponding  eigenvalue  must  be  in  the  open  left-half 
plane.  In  either  case,  Re( A)  <  0;  thus,  F  is  Hurwitz. 

Now,  to  prove  (4.10),  let  u;  €  JR\  add  and  subtract  juX  to  obtain  from  (4.9) 

—[—jul  -  Ft) X  -  X (jul  -F)  +  lrXGGTX  +  HtH  <  0.  (4.12) 

7 

Since  F  is  Hurwitz,  ( jul  —  F)  is  invertible.  Define 

K(ju)  =  ±GTX{juI-F)-'G-, 

pre-multiply  (4.12)  by  XQT^juj  _  p T)-1,  and  post-multiply  by  —  F)~lG  to  obtain 

-K( »  -  KT(-ju)  +  KT(-ju)K(ju)  +  irr(»rM  <  o, 

which  gives 

1  -  ^TT(-}v)T(ju)  >11-  KTi-,u)][l  -  A'(jw)]. 

Therefore,  for  all  u  6  IR, 

1  -  ~T-^)T(ju)  >  [/  -  A-OuOn/  -  K(ju)]  >  0, 
which  implies  (4.10).  □ 
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4.3  The  General  Approach 

Lemma  4.1  suggests  an  approach  to  deriving  i/oo-norm-bounding  control  designs:  The 
approach  is  to  first  fix  a  controller  structure,  so  as  to  determine  the  form  of  the  closed- loop 
system 

xe  =  Fexe  +  Ge  we,  z  =  Hexe,  (4.13) 

and  then  select  feedback  and  observer  gains  so  that  the  algebraic  Riccati  equation 

FlXe  +  XeFe  +  X:XtGeGTeXe  +  HjHe  =  0  (4.14) 

a* 

has  a  solution  Xe  >  0.  By  Lemma  4.1,  if  (FeyHe)  is  a  detectable  pair,  then  the  closed-loop 
system  (4.13)  is  stable,  and  T(s)  =  He(sl  —  Fe)~lGe  satisfies  WT]]^  <  a. 

By  taking  this  approach,  the  same  state-feedback  and  output-feedback  control  designs 
given  in  [48]  and  [1]  according  to  Theorems  4.1  and  4.2  are  recovered  in  Section  4.4.  These 
derivations  are  simple,  and  serve  to  illustrate  the  approach  and  to  introduce  the  derivation 
of  a  new  observer- based  decentralized  control  law  in  Section  4.5.  In  the  decentralized  case, 
controller  feedback  gains  are  computed  from  the  solution  to  a  state-feedback  design  ARE, 
while  observer  gains  are  computed  from  a  Riccati-like  algebraic  equation.  The  existence 
of  appropriate  solutions  to  the  design  equations  is  sufficient  to  guarantee  the  control  to  be 
Hoq- norm-  bounding. 

4.4  The  Centralized  Control  Design 

The  output-feedback  H control  law  given  in  Theorems  4.1  and  4.2  are  now  derived, 
based  on  Lemma  4.1.  This  derivation,  which  also  appears  in  [11],  is  not  a  complete  proof  of 
Theorems  4.1  and  4.2,  in  that  it  establishes  only  that  the  designs  are  sufficient  to  guarantee 
a  predetermined  //oo-norm  bound,  and  not  that  any  achievable  bound  can  be  obtained  using 
such  designs.  For  this  reason,  not  all  the  stabilizability  and  detectability  conditions  appearing 
in  Theorem  4.1  and  4.2  are  needed. 

The  problem  here  is  to  derive  control  laws  to  stabilize  the  plant  (4.1)  and  provide  an  H0 Q- 
norm  bound  for  the  closed-loop  transfer  function  matrix  from  the  disturbance  wt  =  (’M  to 
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z.  By  Lemma  4.1,  a  sufficient  condition  for  a  state-feedback  control  u  =  K x  to  stabilize  the 
plant  and  guarantee  the  //oo-norm  bound  HTjloo  <  a  is  that  the  feedback  gain  matrix  K 
satisfy 


with  X  >  0.  Rearrange  (4.15)  as 

AtX  +  XA+  X;XGGtX  -  XBBtX  +  (Kt  +  XB){I<  +  BTX)  +  HT H  =  0, 

or 

which,  upon  setting  K  =  —BTX,  gives  the  state-feedback  design  equation  (4.3).  If  ( A,H )  is 
a  detectable  pair,  then  the  detectability  condition  of  Lemma  4.1  is  satisfied  for  the  closed-loop 
system.  Thus,  the  state- feedback  design  given  in  Theorem  4.1  is  recovered  via  Lemma  4.1. 

In  the  output-feedback  case,  an  observer- based  control  law  will  be  used  to  approximate 
a  state-feedback  control  it  =  Kx.  To  mimic  the  dynamics  of  the  plant  (4.1),  the  observer 
takes  the  form 

(  =  A£  +  Bu  +  Gwq  +  L(y  -  CO,  «  =  KO  (4.16a) 

where  a  state- feedback  model  of  the  disturbance  Wq  is  assumed  as 


i*o  =  Kd£. 


(4.166) 


The  feedback  gain  K ,  observer  gain  L,  and  disturbance-estimate  gain  Kd  will  be  chosen  so 
that,  when  controller  (4.16)  is  applied  to  the  plant  (4.1),  the  closed-loop  system  will  satisfy 
the  hypotheses  of  Lemma  4.1. 

Introduce  the  error  vector  e  =  £  —  x,  and  write  the  closed-loop  system  as 


CM'1 


+  BI<  BK 
GKd  A  +  GKd  -  LC 


)(e)  +  (-G  l  )  (l°)  H  P'X'  +  (4-17“) 

“(*£)(’)“*•*■•  (4176) 


Similar  to  the  state-feedback  case,  the  goal  is  to  find  Xe  >  0  such  that 

F?X'  +  X,_F'+-LX'G'6:X'  +  HjH.=  (yl  °). 


(4.18) 
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To  ensure  decoupling  of  (4.18)  into  a  state-feedback  design  ARE  and  an  observer  design 
equation,  look  for  a  block-diagonal  solution 


0. 


Then,  the  upper-left  block  of  (4.18)  is  exactly  Equation  (4.15).  If,  as  in  the  state-feedback 
solution,  X  >  0  solves  (4.3)  and  the  feedback  gain  is  given  by 


K  =  -BrX, 


(4.19) 


then  the  upper- left  block  of  (4.18)  is  satisfied  The  upper-right  block  of  (4.18)  then  gives 
-XBBtX  +  KjGTXl  -  -^XGGtX1  +  XBBtX  =  0, 
which  is  satisfied  if 


or 


Ki  =  -L  gtx. 

or 

Given  the  choices  (4.19)  and  (4.20),  the  lower-right  block  of  (4.18)  gives 

X1(A  +  a-2GGTX  -  LC)  +  {A  +  a~2GGTX  -  LC)TXl 

+  -4  XAGGt  +  LLT)Xl  +  XBBtX  =  0. 
or 

Add  to  (4.21)  the  design  equation  (4.3)  to  obtain  the  ARE 


(4.20) 


(4.21) 


1 


(X  +  Xt  )A  +  AT(X  +  Xl)  +  -^s(X  +  X1)GGT(X  +  Xl)-cSCIC  +  H‘H 

OC* 

+  (i^i L  -  aCr)  {^LT X\  -  ac)  =  0, 

which  suggests  the  choice  for  the  observer  gain  L  as 


(4.22) 


X,L  =  cfC 


2nT 


(4.23) 


In  order  that  L  satisfying  (4.23)  is  guaranteed  to  exist,  impose  the  restriction  X\  >  0.  Now 
introduce 

Y  =  a2{X  +  Xx)-'  >0 

to  transform  (4.22)  into  the  design  ARE  (4.5).  A  solution  Y  >  0  of  (4.5),  with  a2y_1  >  X , 
guarantees  Xe  >  0  solves  (4.18)  when  gains  K,  Kj,  and  L  are  computed  from  (4.19),  (4.20), 
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and  (4.21).  Hence,  by  Lemma  4.1  the  closed-loop  transfer-function  matrix  T(s)  =  Ht(sl  - 
FK)~xGe  satisfies  IjTHoc  <  a,  provided  (Fe,He)  is  a  detectable  pair. 

The  needed  detectability  condition  is  satisfied  if  (A,  H )  is  a  detectable  pair  and  Aa  = 
A  +  a~2GGT  X  —  BBtX  is  Hurwitz.  To  see  this,  let  vT  =  ( v f  u^)  satisfy 


(A-  BBTX  -BBTX  \  /uA  _  . 

^  a~2GGTX  >1  +  a~2GGTX  -  LC  )  \v2)  ~ 

Hev  =  (  _£Tx  _qTX  )  („*)  = 


(4.24) 

(4.25) 


and  try  to  show  that  Re( A)  <  0.  The  upper  half  of  (4.24)  and  the  lower  half  of  (4.25) 
give  Avi  =  Hv i,  while  the  upper  part  of  (4.25)  gives  Hv i  =  0.  Since  ( A,H )  is  assumed  a 
detectable  pair,  this  implies  either  Re( A)  <  0  or  ui  =  0.  Suppose  t>i  =  0;  then  the  lower  half 
of  (4.24)  gives 

(A  +  ^ GGtX  -  LC)  u2  =  Au2.  (4.26) 


Therefore,  pre-multiplying  (4.21)  by  v2  and  post- multiplying  by  u2,  and  using  (4.23),  gives 


2Re{\)vm2Xlv2  +  ^rv;X1GGTXlv2  +  c?v\CtCv2  +  vm2XBBTXv2  =  0.  (4.27) 

or 

Since  every  term  but  the  first  in  (4.27)  is  nonnegative,  the  first  term  gives 


Re{X)v2X\v2  <  0.  (4.28) 

If  inequality  holds  in  (4.28),  then  Re( A)  <  0.  If  equality  holds  in  (4.28),  then  every  term  in 
(4.27)  is  zero.  Hence,  Cv2  =  0  and  BT Xv2  —  0,  and  thus  (4.26)  gives 

(A  +  a~2GGTX  -  BBtX)  v2  =  Xv2. 

By  assumption,  A  -f  a~2GGT X  —  BBT X  is  Hurwitz;  therefore,  i?e(A)  <  0. 

The  following  theorem  summarizes  the  result. 

Theorem  4.3.  Suppose  (A,H)  is  a  detectable  pair,  X  >  0  satisfies  the  state-feedback 
design  ARE  (4.3)  with  Aa  =  A  4-  a~2GGTX  —  BBT X  Hurwitz,  and  Y  >  0  satisfies  the 
observer  design  ARE  (4.5)  with  {YX}  <  a2.  If  the  observer  gain  is  given  by  (4.8),  then 
the  dynamic  controller  (4.7)  stabilizes  the  plant  (4.1),  and  the  closed-loop  transfer-function 
matrix  T(s)  =  He(sl  —  Fe)~xGe  satisfies  HTHoo  <  a. 
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4.5  The  Decentralized  Control  Design 


The  same  approach  applied  to  the  centralized  control  problem  in  Section  4.4  is  now  applied 
to  the  decentralized  problem.  The  design  derived  here  also  appears  in  [14]. 

Consider  again  the  plant  (4.1)  with  ( A,H )  a  detectable  pair.  To  allow  the  formulation  of 
a  ^-channel  decentralized  control  problem  for  the  plant  (4.1),  adopt  the  following  notation: 


X>u,  =  (Bi  B2...B,) 


=  Bu, 


(4.29a) 


=  C  x  +  u>, 


(4.296) 


•(:)• 


Si  =  B{Bj,  i  €  {1,2,..., 9}, 
S  =  S\  +  S2  4"  •  •  •  +  Sq  —  BBt. 


(4.29  c) 


(4.29d) 

(4.29e) 


The  problem  is  to  design  a  controller  for  each  of  the  q  control  channels,  where  the  ith 
controller  uses  the  local  measurement  y;  to  generate  the  local  control  u,  for  the  plant. 

The  basic  decentralized  control  law  to  be  developed  stabilizes  the  plant  and  provides  a 
predetermined  Boo -norm  bound  for  the  closed-loop  transfer-function  matrix  from  we  to  z. 
The  controllers  which  make  up  the  control  law  are  based  on  observers  which  form  estimates 
£,,  1  6  (1,2, . . .  ,q),  of  the  state  x  for  feedback.  The  state  estimates  are  used  for  feedback  so 
as  ta  approximate  the  state- feedback  control 


u  =  —BtXx, 


(4.30) 


where  X  >  0  satisfies  the  ARE 


ArX  +  XA+  - -XGGtX  -  XSX  +  HtH  =  0. 


(4.31) 
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That  is,  the  ith  control  is  given  by 


(4.32) 


which  approximates  a  subvector  of  the  state-feedback  control  (4.30).  To  mimic  the  plant 
dynamics,  the  zth  observer  should  ideally  have  the  form 

it  =  BjUj  +  Gw0  +  L,(y;  -  C,6),  (4.33) 

j=i 

where  L,  is  some  observer  gain  matrix.  However,  since  the  disturbance  w0  and  the  controls 
uji  j  7^  are  not  available  to  the  observer,  (4.33)  cannot  be  implemented  directly.  Just  as 
the  centralized  observer  (4.16)  uses  (4.20)  as  an  estimate  of  the  worst  disturbance,  the  ith 
decentralized  observer  replaces  iu0  in  (4.33)  by 

<i>;  =  (4.34) 

The  ith  observer  also  replaces  Uj,  j  i,  by 

=  -BjX(„  (4.35) 


which  are  approximations,  based  on  the  state  estimate  of  the  tth  controller,  of  the  controls 
applied  by  the  other  controllers  according  to  their  shared  strategy.  With  the  control  (4.32), 
the  observer  structure  (4.33),  and  estimates  (4.34)  and  (4.35),  the  ith  controller  becomes 


ii  =  (A  +  ^GGtX  -SX-  T,C.)  6  +  LiVi 


Ui  = 


-BfX  f„ 


(4.36a) 

(4.366) 


where  the  observer  gains  Li ,  i  €  {1,2,..., q},  are  to  be  determined. 


Applying  the  q  controllers  (4.36)  to  the  plant  (4.1)  gives  a  closed-loop  system  of  order 
(q  4-  l)n  described  by 


(4.37a) 

(4.376) 
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where  (T  =  (([  ...  <fj),  and 


Aac  =  Diag  (Aa,  Aa,...,Aa)  (4.38a) 

A.  =  A  +  X-GGtX  -  SX,  (4.386) 

Or 

Bc  =  Di&g(BuB2,...,B<l),  (4.38c) 

Ce  =  Diag  (Ci,  C2, . . . ,  Cq),  (4.38 d) 

Lc  =  Diag  (Li ,L2,...,Lq),  (4.38e) 

Xc  =  Diag  (*,*,...,*).  (4.38/) 

For  convenience,  define  also 

/J  =  [//...  J]elRnX?n,  (4.38<?) 

Gc  =  7CG,  (4.386) 

AC  =  4,C  +  /C£BCIX  (4.38i) 


Then,  transforming  coordinates  of  (4.37)  such  that  the  last  qn  state  variables  are  the  errors 
e,  =£, -x,  i  G  {1,2,..., q},  gives 

xe  —  Fcxc  “h  Ggtae,  2  —  77cxc, 

where 


Fe  -  A/e  ^  0~2GcGtx  Ac  _  2cCe  )  ’G'  ~  Me  XGe  -  ^  _(?c  Zc  )  >  (4-39a) 

=  BeMe  =  ^  _5rx  )  ’Me  =  (  /c  /  )  •  (4-396) 

The  existence  of  a  (9  4-  l)n  x  (q  +  l)n  matrix  Xe  >  0  satisfying 


1 


FjXe  +  XeFe  +  —X'6e^Xe  +  HjHe  =  0 


a 


(4.40) 
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will  by  Lemma  4.1  guarantee  stability  and  an  H^- norm  bound  for  the  closed-loop  system 
(4.37).  Assume  the  form 

Mo  *,)•  (441) 

with  X  >  0  solving  (4.31)  and  X\  >  0  undetermined,  and  decompose  the  left-hand  side  of 
(4.40)  into  appropriately  sized  blocks  as 

Fjx,  +  X,F,  +  i*.6.<5T X  +  Hi H,  =  (  yV  )  •  (4.42) 

Then,  it  turns  out  that  the  off-diagonal  block  is  identically  zero,  and  that  (4.31)  gives 
Uxx  —  0.  Hence,  independent  of  Lc  and  Xu  (4.42)  becomes 

FJX,  +  x,F.  +  i X.G.G1X,  +  *?*.-(“  L  )  ' 


f/aa  =  (Ac  -  LcCc)T X\  +  Xx(Ac  -  LcCc)  +  4 Xx(GcGTe  +  LeLj)Xx  +  XcBcBjXc. 

a * 

Defining  W  —  a2Xxx,  this  reduces  to 

Un  =  -^X,{WAl  +  AcW  +  —WXcBcBlXcW-WCjCcW  ,  , 

It  is  now  possible  to  pick  Xx  (or,  equivalently,  W)  and  Lc  such  that  U22  =  0.  While  it  is 
logical  in  view  of  Lemma  4.1  to  try  to  eliminate  the  last  term  in  (4.43),  this  is  not  generally 
possible,  since  Lc  must  be  block-diagonal.  Thus,  Lc  is  chosen  to  eliminate  the  n  x  n  main- 
diagonal  blocks  of  Lc  —  WCj .  This  requires 


Le  =  WDCJ, 


(4.44) 


where  WD  is  given  by 


W  = 


Wxx 

WX2 

...  wXq 

w2X 

...  w2, 

wqX 

Wq2 

...  \vqq 

,  WD  =  Diag  (Wxl,W22,  •  •  • ,  W,,), 
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or 

Lx  =  WitCj,  it  {1,2,. (4.45) 

Then,  (4.43)  becomes 

=  ^X,{WA?  +  ACW  +  ^WX,BrBjX,W  -  WCjCcW  +  GcCT 
+  (W  -WD)CjC'i,W  -WcftXt. 

Therefore,  if  W  >  0  satisfies  the  Riccati-like  algebraic  equation 

WArc  +  ACW  +  \WXCBCB*XCW  -  WCjCcW 

a  (4.47) 

+GCGTC  +(W-  WD)C*Cc{W  -  WD)  =  0, 

then  t/2 2  =  0,  and  (4.40)  is  satisfied.  Since  W  >  0  is  required,  Xe  >  0  holds  automatically, 
and  by  Lemma  4.1,  Fe  is  Hurwitz  and  T(s)  =  He(sl  —  Fe)~lGe  satisfies  ||T||oo  <  <*,  provided 
( Fe ,  He)  is  a  detectable  pair.  The  following  lemma  provides  the  needed  result. 

Lemma  4.2.  Given  the  definitions  (4.38)  and  (4.39),  where  X  >  0  satisfies  (4.31),  W  >  0 
satisfies  (4.47),  and  Lc  satisfies  (4.44),  the  pair  ( Fe,He )  is  detectable  under  the  following 
three  conditions: 


(i)  ( A,H )  is  a  detectable  pair; 

(ii)  Aa  =  A  +  a~2GGTX  —  SX  is  Hurwitz; 


(iii)  Aa  +  SX  has  no  eigenvalues  on  the  ju-axis. 


Proof.  Suppose  A  is  an  eigenvalue  of  Fe  corresponding  to  an  unobservable  mode  of  (Fe,  He ); 
that  is,  some  vT  =  (vf  u^)  ^  0  satisfies 


and 


(A-  BBTX 

^  a-iGcCPX 


)  (;)  -  >• 


H 

-BTX 


The  proof  now  consists  of  showing  that  Re( A)  <  0. 


(4.48) 


(4.49) 
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The  lower  block  of  (4.49)  and  the  upper  block  of  (4.48)  combine  to  give  Avx  =  Au,,  while 
the  upper  block  of  (4.49)  gives  Hv\  —  0.  Since  (A,  H)  is  assumed  a  detectable  pair,  this 
implies  that  either  Re( A)  <  0  or  t>i  =  0.  If  vx  =  0,  then  the  lower  block  of  (4.48)  gives 

(Ac  -  LcCc)v2  =  \v2.  (4.50) 

The  detectability  proof  is  completed  by  showing  that  Ac  —  LcCc  is  Hurwitz.  The  bracketed 
expression  in  (4.43)  is  equal  to  zero;  therefore 

(Ae  -  LcCc)W  +  W(AC  -  LcCc)t  +  \\VXcBcBtcXcW  +  GcGj  +  LCLTC  =  0.  (4.51) 

or 

Let  r/*  be  a  left-eigenvector  of  Ac  —  LcCc  corresponding  to  the  eigenvalue  A.  Multiply  (4.51) 
on  the  left  by  77*  and  on  the  right  by  tj  to  obtain 

2Re(\)j1-Wr1  +  -U  -WXcBcBjXcWrj  +  timGeGjn  +  r,mLcLjri  =  0.  (4.52) 

or 

Since  every  other  term  in  (4.52)  is  nonnegative,  Re(X)rjmWT]  <  0,  with  W  >  0  assumed; 
therefore,  Re( A)  <  0.  The  following  argument  demonstrates  that  i?e(A)  ^  0.  If  Re( A)  =  0, 
then  every  term  in  (4.52)  must  be  zero;  hence,  rfLc  —  0.  Then  A  is  an  eigenvalue  of  Ac.  But 
a  similarity  transformation  on  Ac  reveals  that  it  can  have  no  imaginary  eigenvalues:  If 

/ 

-I  I 

-I  0  ...  / 

then 

Aa  +  SX  S2X  ...  SqX 
A a  ...  0 

Aa 

where  Aa  is  assumed  Hurwitz,  and  Aa  +  SX  is  assumed  to  have  no  imaginary  eigenvalues. 

□ 

Under  the  conditions  of  Lemma  4.2,  Fe  is  Hurwitz  by  Lemma  4.1.  Therefore,  Ft  is  also 
Hurwitz,  and  the  closed-loop  transfer-function  matrix  T(s)  =  He(sl  —  Fe)~lGe  =  He(sl  — 


98 


Fe)~lGe  from  we  to  z  satisfies  HTH^  <  a.  Condition  (iii)  of  Lemma  4.2  is  a  new  technical 
condition  which  must  be  introduced  for  the  decentralized  control  problem. 

The  following  theorem  summarizes  the  result: 

Theorem  4.4.  Let  (A,H)  be  a  detectable  pair  and  a  be  a  positive  scalar.  Suppose  X  >  0 
satisfies 

AtX  +  X.4  +  \XGGTX  -  XSX  +  HtH  =  0,  (4.31) 

Aa  s  A  +  a~2GGT X  —  SX  is  Hurwitz,  and  Aa  +  SX  has  no  ju-axis  eigenvalues.  Let  W  >  0 
satisfy  the  Riccati-like  algebraic  equation 

WAj  +  ACW  +  \\VXcBcBtcXcW  -  WCjCcW 


(4.47) 


+GcGj  +  (W-  Wd)CtcCc{W  -  WD)  =  0. 

If  the  observer  gains  Li,  i  €  { 1 , 2, . . . ,  9} ,  are  given  by 

U  =  W^cj, 

then  the  decentralized  feedback  control  law 

it  =  +  — jGGtX  —  SX  —  L,C^j  +  L,y,,  i  €  {1,2, ...  ,q}, 

u.  =  -Bj X{,,  ie{i,2,...,q}, 


(4.45) 


(4.36a) 

(4.365) 


stabilizes  the  plant  (4.1),  with  decentralized  structure  given  by  (4.29),  and  the  closed-loop 


transfer-function  matrix 


T(s)  =  H'(sI-F')-'Ge 


from  w e  to  z  (with  Fe,  Ge,  and  He  defined  in  (4.37))  satisfies 

imioo  <  a. 


4.6  Example  1 

Consider  the  plant  (4.1)  with  q  =  2  and 
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C,  =  [1  0  0  0]  C2  =  [0  0  1  0]  H-[  10-10]. 

The  spectrum  of  A  is  {-2.56,  -1.32  ±  j2.92,  +0.19};  hence,  the  plant  has  an  unstable  mode. 

To  compute  a  decentralized  control  for  this  plant,  first  form  the  coefficients  of  (4.47)  from 
the  plant  matrices  and  the  state-feedback  design  equation  solution.  Then,  solve  (4.47)  by  an 
iterative  method:  Compute  an  approximate  solution  WQ  by  ignoring  the  complicating  term 
Q  =  ( W  -  WD)CjCc{W  -  WD).  Then  use  WQ  to  compute  an  approximation  of  Q0  of  Q, 
and  use  Qo  in  the  obvious  way  to  compute  the  next  approximate  solution  W\ .  Iterate  this 
procedure  until  the  candidate  solution  makes  the  matrix  norm  of  left-hand  side  of  (4.47) 
less  than  some  acceptable  tolerance;  then  take  VF,  as  the  solution  W  of  (4.47).  The  tolerance 
used  for  this  example  was  0.001. 

Table  4.1  compares  the  closed-loop  eigenvalues  and  Hoo  norms  of  state-feedback  designs 
with  those  of  decentralized  observer- based  control  designs  for  several  values  of  a.  For  a  >  4, 
the  state-feedback  eigenvalues  are  easily  recognizable  in  the  spectra  of  the  decentralized- 
control  systems;  for  smaller  a,  more  interaction  with  other  poles  is  evident.  The  sequence  of 
candidate  solutions  of  the  Riccati-like  equation  converges  for  a  >  2,  while  the  state-feedback 
design  Riccati  equation  has  an  appropriate  solution  for  a  >  1.3. 


4.7  Example  2 


Consider  the  5th-order  plant  (4.1)  with  q  =  2  and 

/  °  i  4-4  i  \  /  0  \  /0\  /  1  \ 

-3-1121  4  0  0 

A  =  0  l-i-l  0  ,  =  0  ,  B2  =  0  ,  G  =  1  , 

21-101  0  0  0 

\  -1  2  1  -2  -2  /  V  0  /  V  2  /  V  1  / 


/10000\ 

1  \  0  1  0  0  0  )  ’ 

The  spectrum  of  A  is 


/  0  0  0  1  0 
\  0  0  0  0  1 


1  0  0  0  0\ 
0  0  10  0 
00010/ 


A(4)  =  (-0.0108  ±;3.717, -3.7138, -1.5906, +1.3262}; 
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Table  4.1:  Closed- loop  spectra  and  norms  for  varying  a. 


State  Feed 
Spectrum 

back 

imu 

Decentralized  Contro 
Spectrum 

1 

im  I* 

a  =  20 

-0.24 

-2.54 

-1.45ij2.98 

2.30 

-0.24  -2.52  -1.26ij2.90 
-0.38  -2.54  -1.47ij2.97 
-1.07  -2.70  -1.45ij2.98 

3.64 

a  =  16 

-0.24 

-2.54 

-1.45ij2.98 

2.30 

-0.24  -2.52  -1.26±;2.90 
-0.38  -2.54  -1.47ij2.97 
-1.08  -2.70  -1.45ij2.98 

3.63 

a  =  12 

-0.24 

-2.54 

-1.45ij2.98 

2.29 

-0.25  -2.52  -1.26ij2.90 
-0.38  -2.54  -I.47ij2.97 
-1.08  -2.70  -1.45±j2.98 

3.59 

a  =  8 

-0.24 

-2.54 

-1.45ij2.98 

2.27 

-0.27  -2.52  -1.26±j2.90 
-0.37  -2.54  -1.47±j2.97 
-1.09  -2.70  -1.45±j2.98 

3.49 

a  =  4 

-0.27 

-2.54 

-1.46ij2.98 

2.15 

-0.35±j0.08  |  -1.26±;2.91 
-1.18  -2.54  -1.47±;'2.97 
-2.49  -2.71  -1.45±;2.98 

3.05 

II 

e 

-0.46 

-2.54 

-1.46ij2.98 

1.76 

-2.36±j0.85  |  -1.21±j2.98 
-0.48  -2.53  -1.47±j2.98 
-1.38  -2.79  -I.45ij2.94 

1.995 

a  =  1.3 

-2.59 

-3.11 

-1.45ij2.94 

1.30 

none 

none 

hence,  the  plant  has  an  unstable  mode  and  a  lightly-damped  stable  mode.  This  section  gives 
the  results  of  //oo-suboptimal  control  designs  for  this  plant.  First,  state-feedback  solutions 
are  presented,  then  observer- based  solutions,  both  centralized  and  decentralized.  For  various 
values  of  the  design  parameter  a,  the  spectrum,  feedback  and  observer  gains,  and  Hoo  norm 
for  the  closed-loop  system  are  given. 


4.7.1  State  feedback 

State-feedback  designs  can  be  computed  for  values  of  a  varying  from  oo  to  1.069199. 
For  a  =  1.069198,  the  solution  X  of  the  state-feedback  design  ARE  (4.3)  has  a  negative 
eigenvalue;  hence,  for  all  practical  purposes,  a <*>  =  1.069199. 
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The  closed-loop  poles  are  the  eigenvalues  of  F  =  A  —  SX .  Figure  4.1  shows  the  position 


Figure  4.1:  State-feedback  poles  for  varying  a  Example  2. 


of  the  closed-loop  poles  for  a  varying  from  oo  to  a^,.  Note  that  as  a  decreases  from  oo  to 
2.0,  the  poles  barely  move.  As  a  decreases  from  2.0  to  1.1,  the  most  oscillatory  mode  is 
damped  somewhat,  and  the  other  complex  pole-pair  meets  at  the  real  axis  and  splits  into  a 
real  pair.  Finally,  as  a  decreases  in  the  short  interval  from  1.1  to  a^,  the  closed-loop  poles 
are  extremely  sensitive  to  variations  in  a:  The  two  remaining  complex  poles  move  leftward 
in  the  complex  plane  and  meet  at  the  real  axis,  then  one  pole  goes  toward  — oo.  Naturally, 
moving  a  pole  far  into  the  left-half  plane  requires  high  feedback  gains:  The  LQ  feedback 
matrix  is 


Klq  = 


( 


-0.51 

-0.48 


-1.00 

-0.40 


-0.21 

0.44 


-0.98 

-0.94 


-0.80  \ 
-0.47  ) 


with  resulting  closed-loop  spectrum 


\(F)  =  {-0.92  ±;'3.98, -1.78  ±;0.35,  -3.54} 
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while  a  nearly  i/oo-optimal  (a  =  1.07)  feedback  matrix  is 


/  13.21  -3.67  -51.59  61.76  7.93  \ 

^  -66.51  3.97  189.88  -235.86  -40.62  j 


with  resulting  spectrum 


A  (F)  =  {-81.54,-10.51,-3.65,-2.63,-1.57}. 


These  gains  are  much  larger  than  the  LQ  gains,  and  they  also  have  different  signs. 
Reducing  a  to  ttoo  =  1.069199  results  in  gains  (and  one  closed-loop  pole)  of  magnitude 
larger  than  10s. 


4.7.2  Centralized  observer  feedback 


Observer- based  centralized  controls  can  be  computed  by  the  method  given  in  Theorem  4.1 
for  values  of  a  ranging  from  oo  to  1.913.  For  a  =  1.912,  the  solutions  X  and  Y  of  (4.3)  and 
(4.5)  do  not  satisfy  the  condition  (TnULX{YX }  <  or2. 

Figure  4.2  shows  the  position  of  the  closed-loop  poles  for  a  varying  from  oo  to  1.913.  As 
a  falls  from  oo  to  3.0,  the  most  oscillatory  modes  are  damped  somewhat,  and  all  but  the 


leftmost  of  the  real  poles  move  to  the  left  on  the  real  axis.  As  a  falls  from  3.0  to  2.4,  the 


two  leftmost  real  poles  meet,  split  into  a  complex  pair,  circle  leftward,  meet  again  on  the 
real  axis,  and  move  apart.  Again,  as  a  approaches  its  minimum,  one  pole  moves  off  toward 
— oo.  As  a  decreases  from  oo  to  1.913,  each  real-axis  pole  effectively  shifts  from  its  original 
LQG  position  to  the  LQG  position  vacated  by  the  pole  to  its  left,  leaving  the  rightmost  LQG 
position  vacant  and  moving  the  leftmost  real-axis  pole  toward  —  oo. 


The  LQG  (a  =  oo)  observer-gain  matrix  is 


Llqg  = 


/ 

1.37 

-0.71 

0.09 

0.21  \ 

-0.71 

1.95 

0.79 

0.70 

0.40 

0.24 

0.26 

0.31 

0.09 

0.79 

1.03 

0.15 

V 

0.21 

0.70 

0.15 

0.61  , 

with  resulting  closed-loop  spectrum 


A (Fe)  =  {—0.92  ±  j3.98,  —1.78  ±  j0.35,  —3.54, 


-1.09  ±  j3.82,  -1.32,  -1.69,  -3.78}, 
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Figure  4.2:  Output-feedback  poles  for  a  varying  a,  Example  2. 


while  the  observer-gain  matrix  for  a  = 

1.92  is 

(  2.47 

1.90 

3.26 

1.29  \ 

1.90 

94.47 

98.89 

24.57 

L  = 

1.55 

25.95 

27.67 

7.12 

3.26 

98.89 

105.59 

25.42 

^  1.29 

24.57 

25.42 

7.04  , 

with  resulting  spectrum 


A (Fe)  =  {-204.31,  -1.22  ±  >4.41,  -1.47  ±  >3.29,  -1.75  ±  >0.42,  -3.83,  -3.51,-1.65}. 

Reducing  a  to  1.913  results  in  some  gains  (and  one  pole)  with  magnitudes  on  the  order  of 

103. 
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4.7.3  Decentralized  control 


Decentralized  controls  can  be  computed  by  the  method  given  in  Theorem  4.2  for  values 
of  a  ranging  from  oo  to  2.3323.  The  solution  of  the  Riccati-like  algebraic  equation  (4.47) 
is  obtained  using  the  simple  iterative  method  described  in  Section  4.6.  The  smaller  the 
value  of  a,  the  more  iterations  are  required  to  obtain  convergence:  For  example,  to  satisfy 
a  tolerance  of  0.001  on  the  largest  singular  value  of  the  left-hand  side  of  the  Ri  :cati-like 
equation,  a  =  10  requires  only  6  iterations,  while  a  =  2.35  requires  47  iterations.  To  speed 
up  computations  for  small  a,  the  solution  for  a  slightly  larger  a  can  be  used  as  the  starting 
point;  however,  this  “embedding”  practice  seems  to  result  in  convergence  of  the  algorithm 
only  when  using  the  starting  point  W  =  0  also  results  in  convergence.  For  a  —  2.3322  and 
below,  the  algorithm  does  not  seem  to  converge. 

Figure  4.3  shows  the  position  of  the  closed-loop  poles  for  a  varying  from  oo  to  2.3323. 


Figure  4.3:  Closed-loop  poles  for  decentralized  control,  Example  2. 
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As  a  decreases,  the  oscillatory  modes  are  damped,  and  the  real  poles  move  to  the  left  on 
the  real  axis.  Again,  as  a  approaches  its  minimum,  the  poles  on  the  real  axis  seem  to  be 
shifting  left  into  the  positions  originally  occupied  by  other  poles  for  a  =  oo. 

For  a  =  oo,  the  observer-gain  matrices  are 


/  1.63 

-0.90  N 

(  0.07 

-0.31 

\ 

-0.90 

2.61 

0.98 

1.15 

0.41 

0.40 

,  Li  = 

0.31 

0.44 

-0.04 

1.33 

1.38 

0.16 

k  0.32 

0.65  ) 

^  0.16 

1.22 

while  the  observer-gain  matrices  for  a  =  2.3323  axe 


/ 

3.03 

-3.17  ^ 

f  5.45 

0.97  \ 

-3.17 

19.26 

10.08 

6.02 

0.33 

3.71 

II 

*•4 

3.58 

1.86 

-2.16 

18.89 

11.80 

2.40 

V 

0.76 

2.92  ) 

v  2.40 

3.48  , 

Since  the  solution  for  a  =  2.3323  displays  somewhat  higher  gains  and  an  eigenvalue 
moving  to  the  left,  it  seems  a  reasonable  hypothesis  that  solutions  may  exist  for  smaller  a, 
giving  a  high-gain  result  as  in  the  state-feedback  and  centralized  observer  cases. 


4.7.4  Spectrum  and  Hqo  norm  comparisons 

The  spectra  for  state-feedback  solutions  and  subspectra  for  centralized  and  decentralized 
observer- based  solutions  are  shown  for  various  values  of  a  in  Table  4.2.  The  state-feedback 
poles  are  recognizable  among  the  poles  of  both  observer- based  solutions.  Although  the 
state-feedback  root-locus  plot  (Fig.  4.1)  appears  quite  different  from  the  other  two  (Figs. 
4.2  and  4.3),  the  observer- based  solutions  no  longer  exist  when  a  is  small  enough  that  the 
state-feedback  poles  have  moved  significantly  from  their  LQ  positions. 

The  Hoo  norms  of  the  closed-loop  systems  are  compared  for  a  <  5  in  Figure  4.4.  The 
norms  are  seen  to  be  monotone  increasing  with  a.  For  a  =  oo,  the  H <*,  norms  are  HTHoo  = 
1.55  for  state  feedback,  ||T'|j00  =  3.322  for  centralized  observer  feedback,  and  HTjloo  =  4.61 
for  decentralized  observer  feedback,  where  T(s)  is  the  closed-loop  transfer  function  matrix 
in  each  case.  As  the  theory  guarantees,  the  Hoc  norms  are  always  smaller  than  the  design 
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Figure  4.4:  Comparison  of  actual  closed-loop  Hoo  norms,  Example  2. 

parameter  a.  In  the  state-feedback  and  centralized  observer-based  designs,  the  actual  H 
norms  and  the  bound  a  are  very  close  for  a  close  to  the  minimum  value.  In  the  decentralized 
case,  the  actual  norm  approaches  the  bound  a  in  the  neighborhood  of  a  =  2.5,  then  falls 
away  slightly  from  the  bound  as  a  approaches  the  minimum  value  for  which  solutions  of 
the  Riccati-like  design  equation  were  computed.  The  “slack”  in  the  bound  suggests  that 
decentralized  designs  guaranteeing  smaller  norms  may  exist,  possibly  corresponding  with 
solutions  of  the  Riccati-like  equation  for  smaller  values  of  a.  Such  solutions  would  have  to 
be  obtained  by  methods  different  from  those  used  in  this  example. 
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Table  4.2:  Closed-loop  eigenvalues. 


State  Feedback 

Centralized 
Output  Feedback 

Decentralized 

Control 

B 

-0.92±j3.89 
-I.78ij0.35 
-  3.54 

-0.92±j3.89 
-1.78±j0.35 
-3.54  . . . 

-0.92±j3.69 
-1.78±j0.35 
-3.54  . . . 

a  =  10 

-0.92±j3.89 
-1.78±j0.35 
-  3.54 

-0.95±j3.93 
-1.77±j0.34 
-3.54  ... 

-0.88±j3.94 
-1.77±j0.34 
-3.54  ... 

a  =  5 

-0.94±j3.89 
-1.78±j0.35 
-  3.54 

-0.97±j4.03 
-1.71±j0.35 
-3.55  . . . 

-0.87±j4.02 
-1.74±j0.32 
-3.56  . . . 

a  =  3 

-0.99±j3.89 
-1.78±j0.35 
-  3.54 

-1.01±j4.17 
-1.73±j0.43 
-3.60  ... 

-0.86±j4.18 
-1.66±j0.46 
-3.58  ... 

a  =  2.5 

-1.03±j3.89 
-1.78±j0.36 
-  3.54 

-1.04±;4.26 
-1.74±j0.43 
-3.46  ... 

-0.90±j4.35 
-1.72±j0.46 
-3.67  ... 

a  =  2 

-1.12±;3.89 

-1.78±;0.36 

-3.54 

-1.17±j4.39 
-1.75±;0.42 
-3.51  ... 
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5  RELIABLE  CONTROL  DESIGN 


This  section  develops  centralized  and  decentralized  control  designs  which  guarantee  sta¬ 
bility  and  a  predetermined  /foo-norm  bound  despite  measurement  or  control  failures.  Such 
designs  are  referred  to  here  as  “reliable”. 

There  have  been  various  attempts  in  the  past  to  develop  methodologies  for  the  design  of 
reliable  control  systems,  and  these  attempts  have  had  differing  reliability  goals.  Among  the 
most  prominent  attempts  are  [39],  [58],  [59],  [60],  [61],  [62]  and  [63].  The  design  methodology 
presented  here  differs  from  all  previous  attempts  in  that  it  is  the  first  to  produce  controls  that 
guarantee  stability  and  a  //oo-norm  bound  for  the  base  case  when  all  sensors  and  actuators 
are  operative  as  well  as  in  case  of  outages  of  certain  sensors  or  certain  actuators. 

Section  5.1  presents  an  example  which  establishes  the  need  for  a  reliable  decentralized 
design.  Section  5.2  develops  centralized  reliable  designs,  which  guarantee  stability  and  an 
//oo-norm  bound  despite  possible  outages  of  sensors  or  actuators  within  predefined  suscep¬ 
tible  sets.  The  cases  of  sensor  and  actuator  outages  are  treated  separately,  resulting  in  two 
designs  with  different  reliability  properties.  Section  5.3  presents  decentralized  reliable  de¬ 
signs  which  guarantee  stability  and  an  H^- norm  bound  despite  possible  outages  of  certain 
control  channels  in  the  decentralized  system.  The  control  channel  outages  are  modelled  first 
as  measurement  outages,  and  then  as  control  input  outages,  resulting  in  two  distinct  designs 
with  the  same  reliability  properties.  Section  5.4  present  results  on  the  design  of  strongly 
stable  systems. 

5.1  Motivation 

The  4th-order  example  of  Section  4.6  is  used  to  motivate  the  development  of  a  reliable 
decentralized  control.  In  this  example,  stability  and  a  predetermined  i/c-norm  bound  are 
guaranteed  by  the  basic  decentralized  design  for  various  values  of  the  design  parameter  a. 
Table  5.1  gives  the  actual  H<x,  norms  of  the  closed-loop  systems  corresponding  with  several 
values  of  a.  In  addition  to  the  case  when  no  controller  failure  occurs,  Table  5.1  gives  the 
conditions  corresponding  with  a  failure  of  each  of  the  two  controllers.  A  failure  of  Controller 
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Table  5.1:  //<*,  norms  for  the  basic  decentralized  design. 


no  failure 

#1  fails 

#2  fails 

a  =  20 

3.64 

unstable 

5.34 

a  =  16 

3.63 

unstable 

5.30 

a  =  14 

3.61 

unstable 

5.28 

a  =  12 

3.59 

unstable 

5.23 

a  =  8 

3.49 

unstable 

5.04 

a  —  4 

3.05 

unstable 

4.19 

a  =  2 

1.995 

unstable 

2.46 

#1  results  in  instability  for  each  design  computed,  while  a  failure  of  Controller  #2  results 
only  in  an  increased  H0 0  norm  for  the  closed-loop  system. 

Since  the  plant  is  open-loop  unstable,  a  failure  of  both  controllers  at  once  necessarily 
results  in  instability;  however,  it  would  be  desirable  to  alter  the  design  so  as  to  guarantee 
at  least  stability,  and,  better  still,  some  level  of  disturbance  attenuation  for  the  closed-loop 
system  if  only  one  controller  should  fail.  While  the  basic  design  in  this  case  still  works  well 
if  only  Controller  #2  fails,  it  is  not  acceptable  if  Controller  #1  fails.  Therefore,  a  design 
reliable  with  respect  to  failure  in  Controller  #1  is  desired. 

The  essential  idea  in  developing  a  reliable  design  methodology  is  that,  if  there  exists 
Xe  >  0  satisfying 

FjXe  +  X'Fe  +  —2X'G'GTtXt  +  Hj  He  +  Pe  =  0  (5.1) 

or 

with  some  Pe  >  0,  then  the  resulting  closed-loop  system  will  by  Lemma  4.1  be  stable  and  have 
//oo-norm  bound  a.  Choosing  Pe  =  0  in  (5.1)  yields  the  basic  centralized  and  decentralized 
designs  derived  in  Section  4,  characterized  by  closed-loop  stability  and  the  bound  HTHoo  <  a. 
Identification  of  the  appropriate  Pe  can  ensure  additional  system  properties  associated  with 
reliability.  It  turns  out  that  the  appropriate  choices  of  Pe  introduce  perturbations  into  the 
basic  design  equations  equivalent  to  appending  columns  or  rows  to  G  or  H  in  the  basic  design 
equations.  Preliminary  results  on  design  of  reliable  control  systems  were  presented  in  [15]. 
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5.2  Reliable  Centralized  Design 

The  problem  addressed  here  is  that  of  designing  a  centralized  controller  which  is  reliable 
despite  possible  sensor  or  actuator  outages.  The  outages  will  be  restricted  to  occur  within 
a  preselected  subset  of  available  measurements  or  control  inputs.  The  controllers  developed 
will  guarantee  closed-loop  stability  and  a  predetermined  //oo-norm  bound,  regardless  of  ad¬ 
missible  sensor  or  actuator  failures.  The  cases  of  sensor  and  actuator  outages  are  treated 
separately,  and  two  designs  are  developed  to  handle  the  two  cases.  However,  it  will  be  clear 
from  the  results  that  controllers  which  can  handle  both  sensor  and  actuator  outages  can  be 
obtained  by  combining  the  designs. 

Consider  first  the  design  of  a  controller  that  can  tolerate  the  outage  of  certain  sensors 
which  provide  the  various  elements  of  the  measurement  vector  y.  Let  ft  C  {1,2,...,  dim(y)} 
correspond  with  a  selected  subset  of  sensors  susceptible  to  outages.  Introduce  the  decompo¬ 
sition 

C~Cn  +  Cfl,  (5-2) 

where  Cq  denotes  the  measurement  matrix  associated  with  ft,  and  Co  denotes  the  measure¬ 
ment  matrix  associated  with  the  complementary  subset  of  measurements.  In  other  words, 
Co  is  the  same  as  C,  but  with  rows  corresponding  with  susceptible  sensors  zeroed  out.  Let 
u  C  ft  correspond,  with  a  particular  subset  of  the  susceptible  sensors  that  actually  experi¬ 
ence  an  outage,  and  let  T^(s)  denote  the  transfer-function  matrix  of  the  resulting  closed-loop 
system.  It  is  convenient  to  adopt  the  notation 


C  —  Cw  4-  Cqj  (5.3) 

where  Cw  and  CQ  have  meanings  analogous  to  those  of  Cq  and  Co  in  (5.2).  Since  u;  C  ft, 
C^CW  <  CqCo-  Also  decompose  the  observer  gain  as 


so  that 


L  —  Lw  -f  Lq 


LC  —  LUC„  4-  LqCcj. 


(5.4) 
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(La  has  columns  zeroed  out  corresponding  with  sensors  which  have  actually  failed.)  Then 
the  following  result  holds: 


Theorem  5.1.  With  all  assumptions  and  the  design  otherwise  as  in  Theorem  4.3,  assume 
X  >  0  and  Y  >0  satisfy  the  AREs 

AtX  +  XA-  XSX  +  ~XGGtX  +  HtH  +  a2C£Cn  =  0,  (5.5) 

CXl 

AY  +  YAT  +  -jj YHtHY  -  YClCfiY  +  GGT  =  0,  (5.6) 

respectively.  Then,  for  sensor  outages  corresponding  with  any  u  C  Q,  the  closed-loop  system 
is  stable,  and  ||T0||oo  <  ot. 


Remark  5.1:  With  all  sensors  operational,  corresponding  with  u>  =  0,  T&(s)  =  T(s)  is  the 
transfer-function  matrix  from  we  to  z,  where 


w. 


Theorem  5.1  covers  this  case  automatically,  since  u  =  0  C  Q.  If  sensors  corresponding  to  a 
nonempty  subset  u>  C  Q  fail,  then  T*(s)  is  the  transfer-function  matrix  from  weCJ  to  z ,  where 


w. 


-(:)■ 


with  W&  containing  only  those  components  of  measurement  noise  associated  with  operational 
sensors. 

Proof.  The  design  equations  (5.5)  and  (5.6)  arise  from  replacing  H  in  the  description  of  the 
plant  by  the  augmented  matrix 

MJJ’  (s-7) 

and  changing  the  design  equations  accordingly.  If  (5.5)  and  (5.6)  have  appropriate  solutions, 
then  Theorem  4.3  guarantees  that  Xe  >  0  satisfies 

1 


FjXe  +  X'Fe  +  —X'G'G^X'  +  Hj+He+  =  0, 
where  the  augmented  closed-loop  system  is  described  by  the  matrices 


(5.8) 


■=( 


A  -SX 
LC  A0  -  LC 


)'G*=(?  2  -B*X  )  '  <5S» 
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and  ( Fe ,  He+)  is  a  detectable  pair.  The  actual  closed-loop  system  with  no  sensor  outages  is 
described  by  the  matrices 


Ft  = 


A  -SX  \  _  (  G  0  \  /  H 

LC  Aa-LC]'  *~\  0  L)'ne~\  0 


0 

-BTX 


(5.10) 


For  sensor  outages  corresponding  with  w  C  the  controller  becomes 

(=U  +  GGtX  -  SX  -  Lc'jt  +  Lay,  (5.1  la) 

u  =  —BtX£.  (5.116) 

The  controller  dynamic  structure  is  not  affected  by  a  sensor  outage;  only  the  controller  input 
structure  is  effectively  changed.  Given  (5.11),  the  closed-loop  system  matrices  become 


F  _(  A  -SX\  (G0\  (H  0 

\  LoC*  Aa-  LC  )  '  eQ  ~  \  0  La  )  ’  ~  \  0  -BtX 

The  following  useful  relations  are  derived  from  (5.9),  (5.10),  and  (5.12): 

Fe  =  FgQ  +  ^  ^  (Cw  0)  =  FeQ  +  LeuCew, 

g‘g •  -  (  t  l!li  ) + i°y° Li) = G»G- + 

Hl+H'+  =  HjH'  +  a1(C»Ga 
Use  (5.8)  and  (5.13)  to  obtain 

F&X.  +  X'F,q  +  —2X'Gt*G^X'  +  HjHe 

a* 

=  -ClLlX'  -  XeLewCew  -  ^X'L^LlX'  -  a2^n^(Cn  0] 

Therefore,  since  -CqCq  <  — CjCL,,  (5.14)  gives 

FjaXe  +  XtFcQ  +  ■^-XtGt^Xt  +  HfH' 

Q  1 

<  -ClLlXt  -  XeLevCeu  -  —X^L^X'  -  a2C^C«. 
=  -  (i XtLew  +  oCi)  (~ L^wXe  +  aCeu,)  <  0. 


(5.12) 

(5.13a) 

(5.136) 

(5.13c) 

(5.14) 


(5.15) 
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Hence,  provided  (FeCj,  He)  is  a  detectable  pair,  Lemma  4.1  guarantees  that  Feii  is  Hurwitz, 
and  that  T^a)  —  He(sl  —  FeG>)~xGeQ,  the  transfer- function  matrix  from  weCJ  to  z&,  satisfies 
Halloo  <  a.  The  detectability  proof  is  routine:  If  vT  =  (vf  vj)  ^  0  satisfies  FeQv  =  Xv  and 
Hev  =  0,  then  Av i  =  Ai>i  and  Hv\  =  0,  with  (A,  H)  assumed  a  detectable  pair.  Therefore, 
either  Re( A)  <  0  or  =0.  Suppose  uj  =  0;  then  Fev  =  Fet) v  =  Xv  and  Hev  =  0  gives 
He+v  =  0.  Since  (Fe,  He+)  is  a  detectable  pair,  fie(A)  <0.  □ 

Consider  now  the  design  of  a  controller  that  can  tolerate  the  outage  of  certain  actua¬ 
tors  which  provide  the  various  elements  of  the  control  vector  u.  Let  f 2  C  {1,2,  ...,dim(u)} 
correspond  with  a  selected  subset  of  actuators  susceptible  to  outages.  Introduce  the  decom¬ 
position 

B=Bn  +  Ba,  (5.16) 

where  Bn  denotes  the  control  matrix  associated  with  the  set  Q,  and  Bn  denotes  the  control 
matrix  associated  with  the  complementary  subset  of  control  inputs.  In  other  words,  Bn  is 
the  same  as  B,  but  with  columns  corresponding  with  susceptible  actuators  zeroed  out.  Let 
u>  C  fl  correspond  with  a  particular  subset  of  the  susceptible  actuators  that  actually  fail, 
and  let  Ti(s)  denote  the  transfer-function  matrix  of  the  resulting  closed-loop  system.  It  is 
convenient  to  adopt  the  notation 

B  =  Bw  +  Bq  (5.17) 


where  Bw  and  B&  have  meanings  analogous  to  those  of  Bq  and  Bn  in  (5.16).  Since  u>  C  fl, 
BwBl  <  BqBq.  Then  the  following  result,  dual  to  Theorem  5.1,  holds: 


Theorem  5.2.  With  ail  assumptions  and  the  design  otherwise  as  in  Theorem  4.3,  assume 
X  >  0  and  Y  >  0  satisfy  the  AREs 


AtX  +  XA-  XBnBlX  +  ±-XGGTX  +  Hr H  =  0, 

or 


AY  +  YAt  +  —YHtHY  -  YCtCY  +  GGT  -I-  a2BnBl  =  0, 

or 

respectively.  Define 


G+  =  (G  aBoh 


(5.18) 

(5.19) 


(5.20) 
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and  let  the  controller  be  given  by 

t  =  (a  +  j^G+GlX  -  SX  -  Lc'j  £  +  Ly, 
u  =  ~BtX£. 


(5.21a) 

(5.216) 


Assume  the  controller  is  open-loop  (internally)  stable.  Then,  for  actuator  outages  corre¬ 
sponding  with  any  u>  C  fi,  the  closed-loop  system  is  stable,  and  ||T&||oo  <  a. 


Remark  5.2:  For  actuator  outages  corresponding  with  u  C  fl,  TQ(s)  is  the  transfer-function 
matrix  from  we  to  zQ,  where  zQ  excludes  control  components  associated  with  failed  actuators. 
Proof.  The  design  equations  (5.18)  and  (5.19)  arise  from  replacing  the  matrix  G  in  the 
description  of  the  plant  (4.1)  with  the  augmented  matrix  G+,  and  introducing  the  corre¬ 
sponding  changes  in  the  design  equations.  If  (5.18)  and  (5.19)  have  appropriate  solutions, 
then  Theorem  4.1  guarantees  that  Xe  >  0  satisfies 


FjX,  +  X.F,  +  Lx.G»ti*+X.  +  HjH,  =  0, 


(5.22) 


where  the  augmented  closed-loop  system  is  described  by  the  matrices 


•  =  ( 


A  -SX 
LC  Aa  -  LC 


)'G~=(G0+  !)•"-(  0  -*X)'  <5-23> 


with  Aq  =  A+a^G+G^X  —  SX  and  ( Fe ,  He)  a  detectable  pair.  When  there  are  no  actuator 
outages,  the  actual  closed-loop  system  is  described  by  the  matrices 


A  -SX 
LC  Ac-LC 


)'G‘=(o  2)'"«=(°  -grx)-  <524> 


For  actuator  outages  corresponding  with  u;  C  Q,  the  controller  becomes 

t  =  (a  +  ^ G+GlX  -SX-LC^tA  Ly, 

«  =  -BlXi. 


(5.25  a) 
(5.256) 


The  controller  dynamic  structure  is  not  affected  by  actuator  outages;  only  the  controller 
output  structure  is  effectively  changed.  Given  (5.25),  the  closed-loop  system  is  described  by 
the  matrices 


eO 


_  (  A  -BaBlX  \  r  _(  G  0  \  „  H  0  \ 
~  [LC  Ac-LC  [  0  L  )  'Mea  ~  \  0  -BIX  )  ‘ 


(5.26) 
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The  following  useful  relations  are  derived  from  (5.23),  (5.24),  and  (5.26): 


F,  =  F,a  -  (M(0  BlX)  =  F,q  -  B„( 0  BlX), 
HjH.  =  BlX), 

G,+Gr+  =  G.Gl  +  a’  ( 


(5.27a) 


(5.276) 


(5.27c) 


Use  (5.22)  and  (5.27)  to  obtain 


FjQXe  +  XeFeQ  +  ±XeGeG*Xe  +  HjaHea 

<  -  (X.B°-  (/J)  {BIX.  -  (0  BlX))  <  0. 


(5.28) 


Provided  (Fean  Hea)  is  a  detectable  pair,  Lemma  4.1  guarantees  that  FeQ  is  Hurwitz,  and  that 
Tcj(s)  =  HeQ(sI-FeQ)-'Ge  satisfies  IjT^lioo  <  a.  To  prove  detectability,  let  vT  =  (vf  vf)  ^  0 
satisfy  FtS) v  =  Xv  and  HeCJv  =  0;  then  Av\  =  At>j  and  Hv\  =  0,  with  ( A,H )  assumed  a 
detectable  pair.  Therefore,  either  Re( A)  <  0  or  Ui  =  0.  If  vx  =  0,  then  Feav  =  Au  gives 


( A  +  ^ G+GlX  -SX-  LC)  =  Au2. 


(5.29) 


By  the  assumption  that  the  controller  is  open-loop  stable,  (i4  +  a~2G+G^X  —  SX  —  LC)  is 
Hurwitz;  therefore,  Re( A)  <0.  □ 

The  design  given  in  Theorem  5.2,  unlike  that  given  in  Theorem  5.1,  requires  that  the 
controller  turn  out  stable  in  order  to  guarantee  reliable  closed-loop  stability.  If  the  design 
does  not  result  in  a  stable  controller,  it  may  be  combined  with  a  strongly  stabilizing  design 
developed  in  Section  5.5;  then  the  assumption  of  open-loop  stability  of  the  controller  will 
hold  automatically. 

Note  that  to  achieve  reliability  with  respect  to  sensor  outages,  it  is  sufficient  to  modify 
the  feedback  and  observer  gains;  however,  to  achieve  reliability  with  respect  to  actuator 
outages,  the  observer  structure  must  also  be  modified.  The  structural  modification  required 
is  the  inclusion  of  G+  in  the  controller  dynamic  matrix. 
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5.3  Reliable  Decentralized  Design 

Let  Cl  C  {1,2, ...,9}  correspond  with  a  subset  of  controllers  subject  to  outages.  The 
problem  is  to  compute  a  decentralized  control  law  which  guarantees  closed-loop  stability 
and  an  //oo-norm  bound  in  spite  of  controller  outages  corresponding  with  any  subset  u>  C  Cl. 
Without  loss  of  generality,  Cl  =  {t  +  1,  t  +  2, . . . ,  9}  and  u  =  {r  +  1,  r  +  2, . . . ,  q],  with  r  >  t. 
Introduce  the  decompositions 
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C$Ca  >  CjC. 


(5.34) 


When  no  controller  failures  occur,  the  closed-loop  system  is  described  by  matrices  of  the 
form 

Fe 


,  _  /  A  -BBj  \  (G0\  (H  0  \ 

'  "  v  Aor.  -  LcCc  )’U’-\0  Lc)'a'-\0  -Bfxc)' 

where  Aac  =  Diag(Aa,  •  • . ,  A»)*  Suppose  that  controller  failures  take  the  form 


Vi  =  0,  *  €  w. 


(5.35) 


The  closed-loop  system  then  takes  the  form 


G)  ■  ( itcQ 


-BBTXC  \  (x\  (  G  0  \  (wQ 
Aac  —  LcCc  )  U;  V  0  )  \w 


F tG>Xe  "b 


(5.36a) 


z  = 


(5.366) 


Because  of  the  assumed  mode  of  failure,  given  by  (5.35),  the  disturbances  Wi,  i  6  w,  do  not 
enter  the  system  (5.36).  In  fact,  (5.36)  is  a  controllability  canonical  form,  with  <f,-,  i  €  u,  the 
uncontrollable  parts  of  the  extended  state  vector.  Note  also  that 


Aac  —  LcCc  —  Diag(/10  —  LiC\,  Aa  —  LiCi, . . . ,  Aa  —  LgCq),  (5.37) 

where  Aa  —  LtC{  is  the  open-loop  dynamic  matrix  of  the  ith  controller.  Because  of  the  form 
of  (5.36),  the  open-loop  eigenvalues  of  the  controllers  which  have  failed  appear  directly  as 
modes  of  the  closed-loop  system.  This  means  that  a  design  guaranteeing  reliable  stability 
will  automatically  guarantee  that  all  controllers  susceptible  to  outages  are  open-loop  stable. 
It  is  convenient  to  note  that  FeC)  and  Gea  are  related  to  Fe  and  Gt  by 


Fe *  =  Fe~  )(Cu,  0)  =  Fe  — 

(5.38  a) 

G-‘=G’-(S  l\ 

(5.386) 

G,aGl  =  G,GJ  -  L^Ll. 

(5.38c) 

The  design  which  follows  will  guarantee  that  FeS/  is  Hurwitz,  and  that  the  transfer-function 
matrix  Ta(s)  =  He(sl  —  Fea)~lGea  satisfies  UTaljoo  <  a,  for  controller  outages  associated 
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with  any  w  C  fi.  The  case  where  no  controllers  fail  (represented  by  u>  =  0  C  0)  is  always 
admissible;  hence,  the  design  will  automatically  guarantee  that  Fe  is  Hurwitz  and  that 
T(s )  =  He(sl  —  Fe)~lGe  satisfies  ||T,||00  <  a.  The  following  theorem  gives  the  reliable 
design. 

Theorem  5.3.  With  all  assumptions  and  the  decentralized  design  otherwise  as  in  Theorem 
4.4,  let  X  >  0  satisfy 

ATX  +  XA  +  \XGGTX  -  XBBtX  +  HtH  +  a2CoCn  =  0,  (5.39) 

or 

where  fl  C  {1,2, . . . ,  q).  Then,  for  controller  outages  corresponding  with  any  w  C  the 
closed-loop  system  (5.8)  is  internally  stable,  and  the  closed-loop  transfer-function  matrix 
Tq(s)  from  weQ  to  za  satisfies  ||7o||oo  <  In  addition,  ail  controllers  corresponding  with 
the  “susceptible”  set  Q  are  open-loop  stable. 


Remark  5.3:  The  design  given  in  Theorem  5.3  results  from  replacing  H  in  the  description 
of  the  plant  (4.1)  with  the  augmented  matrix 


MaC„)' 


(5.40) 


and  changing  the  design  equations  accordingly.  This  substitution  results  in  no  change  in  the 
design  equation  (4.47),  and  is  equivalent  to  selecting  Pe  in  (5.1)  as 


(5.41) 


The  basic  decentralized  design  computed  for  the  augmented  plant  will  provide  reliable  control 
for  the  actual  plant. 

Proof.  Just  as  in  the  development  of  Section  4.5,  the  existence  of  appropriate  solutions  to 
the  perturbed  design  equations  (5.39)  and  (4.44)  guarantees  that  Xe  >  0  satisfies 


where 


FjXe  +  XgFe  +  —XgGgGlXt  +  Hj+He+  =  0, 


-  (  "o  )  . 


(5.42) 


(5.43) 
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Now  (5.38),  (5.40),  (5.42),  and  (5.43)  give 


FIX,  +  X,F,a  +  ^X'G^X'  +  Hj  H, 

=  -ClLlX,  -  X.L^  -  XrX'L^LlX, 

a 


-aico) 


(Cu  0). 


Therefore,  by  (5.34), 


1 


FjQXe  +  XeFeCj  +  —XeGeQG^X'  4-  H;He 

Q  1 

<  -ClLlXe  -  X'L^C'v  -  —XeLewLTewXe  -  a2C£ Cew 


■  / 1  Q 
=  -  (i*e£ew  +  aCL)  {^L l,Xe  +  aCew)  <  0. 


Hence,  provided  (FeanHe)  is  a  detectable  pair,  Lemma  4.1  guarantees  that  Fe*  is  Hurwitz, 
and  that  7^(s)  =  He(Is  —  Feii)~1G<.li,  the  transfer- function  matrix  from  weQ  to  zQ,  satisfies 
Halloo  <  a.  The  detectability  proof  is  the  same  as  that  of  Lemma  4.2:  Assuming  v  ^  0 
satisfies  Fe(Jv  =  \v  and  Hev  =  0  gives  Avt  —  Ai^  and  Hvx  =  0,  with  ( A,H )  assumed  a 
detectable  pair.  Therefore,  either  Re( A)  <  0  or  vx  =0.  If  Uj  =  0,  then  (Aac  —  LcCc) v2  =  Au2, 
and  hence  ( Ac  —  LcCc)u2  =  Au2,  where  Ae  —  LcCc  is  known  to  be  Hurwitz.  □ 

Recall  that  the  closed-loop  system  (5.36)  assumes  measurement  failures  corresponding 
with  each  i  €  u>.  If  instead  there  are  control  input  failures,  that  is,  if  the  controller  failures 
are  given  by 

u,  =  0,  i  6  u/,  (5.44) 


then  the  closed-loop  system  has  the  form 

)(f)  +  (o  +  (545a) 

0  -BJqX'  )  Q  -  H’"x”  (5'456) 

where  FeQ  has  been  redefined.  Note  that  (5.45)  is  an  observability  canonical  form,  with  £, 
i  €  u>,  the  unobservable  parts  of  the  extended  state  vector.  In  fact,  for  a  given  decentralized 
control  law,  (5.36)  and  (5.45)  are  just  two  different  realizations  of  the  same  transfer-function 
matrix.  However,  the  form  (5.45)  leads  to  the  need  for  a  different  matrix  Pe  in  (5.1)  to  guar 
antee  reliable  stability  and  performance,  and  hence  to  a  different  control  law.  Again,  the 
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closed-loop  eigenvalues  of  the  controllers  which  fail  appear  directly  as  modes  of  the  closed- 
loop  system;  unlike  the  proof  of  Theorem  5.3,  however,  the  following  development  must 
assume  that  all  the  controllers  turn  out  open-loop  stable.  If  some  controllers  turn  out  un¬ 
stable,  the  design  of  Theorem  5.4  may  be  combined  with  a  strongly  stabilizing  decentralized 
design  developed  in  Section  5.5. 

It  is  convenient  to  note  that  Fea  and  Hea  are  related  to  Fe  and  He  by 


=  F.  +  (Ho  BlXc)  3  F,  +  0  BlXc) 

=  BIX .) 

HLH^  =  HjH,  -  L“J(0  Blxc). 


0  0 
0  Blxc 


(5.46a) 


(5.466) 


(5.46c) 


The  following  theorem  gives  the  design: 


Theorem  5.4.  With  all  assumptions  and  the  decentralized  design  otherwise  as  in  Theorem 
4.4,  let  X  >0  satisfy 


AJX  +  XA  +  \xGGtX  -  XSqX  +  HtH  =  0, 


(5.47) 


and  let  W  >  0  satisfy 


WATC+  +  Ac+W+  —WXcBcBjXcW  -  WC?CeW.+  GCGTC 
+  a2IcSalJ  +  (W  -  W0)CJCA W  ~  WD)  =  0, 


(5.48) 


where 


Ij  =  [//•../] 

Ac+  =  Ac  +  Diag(SnX,  S0X , . . . ,  SQX), 
Sn  =  BoBq, 

S  =  Sq  +  So, 

and  QC  {1,2, ... ,  ^}.  Let  the  controllers  be  given  by 


1 i  =  {A.  +  —  G+G+X  -  SX  -  LiCi)(i  +  L,y„  i  G  {1,2,. ..  ,<?}, 


(5.49a) 
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ui  =  -B?Xti,  {1,2,...,?},  (5.496) 

and  assume  all  controllers  are  open-loop  (internally)  stable.  Then,  for  controller  outages 
corresponding  with  any  u  C  ft,  the  closed-loop  system  (5.45)  is  internally  stable,  and  the 
closed-loop  transfer-function  matrix  Tq(s )  from  weQ  to  z&  satisfies  ||Ta||oo  <  a. 

Remark  5.4:  The  design  equations  (5.47)  and  (5.48)  arise  from  replacing  G  in  the  plant 
description  (4.1)  with  the  augmented  matrix  G+  given  by 

G+  =  (G  a  Bn),  (5.50) 


and  changing  the  design  equations  accordingly.  This  substitution  affects  both  the  state- 
feedback  design  ARE  and  the  Riccati-like  design  equation  for  computing  decentralized  ob¬ 
server  gains.  The  substitution  is  equivalent  to  selecting  Pe  in  (5.1)  as 

2)*.*°-  <5-5i> 
The  basic  design  computed  for  the  augmented  plant  will  provide  reliable  control  for  the 
actual  plant. 

Proof.  As  in  the  development  of  Section  4.5,  the  existence  of  appropriate  solutions  to  the 
design  equations  (5.47)  and  (5.48)  guarantees  that  Xe  >  0  satisfies 

FjXe  +  XeFe  +  -^XeGe+Gi:+Xe  +  HjHe  =  0.  (5.52) 


Unlike  the  dual  case,  the  additional  columns  of  G+  enter  into  the  linear  coefficient  matrix 
Fe  of  (5.52),  as  well  as  into  the  quadratic  coefficient  as  explicitly  indicated.  This  is  because 
the  controller  structure  (5.49)  is  affected  if  G  is  replaced  by  G+.  Hence,  Fe  and  Ge+  are  now 
given  by 


"■  =  ( 


A  -BBJX  e 
LcC  Aac  —  L,Cc 


)-e— (®+  0’ 


(5.53) 


with  Aac  —  Diag(  Aa,  Aa, . .  • ,  Aa)  and  Aa  =  A  +  a  2G+G+X  —  SX.  Manipulations  of  (5.52) 
similar  to  those  of  the  dual  case,  using  (5.46),  (5.50),  and  (5.53),  give 


FlXt  +  X'F'Q  +  LX'GeGTeXe  + 

<  -  (X'Bev  ~  (xcBaJ)  (&L;Xe  ~  (0  B^XC)  <  0. 
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Provided  ( FeQ ,  Hea)  is  a  detectable  pair,  therefore,  Lemma  4.1  guarantees  that  Fea  is  Hurwitz, 
and  that  TQ(s)  =  HeQ(sI  -  Fe0)-1Ge  satisfies  ||T0||oo  <  a.  To  establish  detectability,  let 
vT  =  (vj  v2)  ^  0  satisfy  FeS)v  =  Xv  and  Heav  =  0.  Then  Avi  =  Avi  and  Hvx  =  0.  Since 
( A,H )  is  a  detectable  pair,  this  implies  either  i?e(A)  <  0  or  t/i  =  0.  Suppose  Vi  =  0;  then 
FeQv  —  Xv  gives 

(Aac  -  LeCc)v2  =  Xv2.  (5.54) 

Since  all  controllers  are  assumed  open-loop  stable,  (5.54)  gives  Re( A)  <0.  □ 

The  two  decentralized  designs  given  in  Theorems  5.3  and  5.4  model  controller  failures 
as  being,  respectively,  measurement  failures  and  actuator  failures.  The  failures  considered 
incapacitate  entire  controllers,  so  that  measurement  failures  and  actuator  failures  have  the 
same  effect  on  the  closed-loop  transfer-function  matrix.  Although  the  two  designs  have  the 
same  reliability  goals,  they  are  nevertheless  different:  The  first  automatically  guarantees 
reliable  stability  if  the  design  equations  have  appropriate  solutions,  whereas  the  second  may 
exist  but  not  guarantee  reliable  stability  if  the  controllers  are  not  open-loop  stable;  the  first 
design  involves  only  modification  of  feedback  and  observer  gains  as  compared  with  the  basic 
design,  while  the  second  requires  also  a  change  in  the  observer  structure;  and  the  range  of 
the  design  parameter  a  for  which  the  two  designs  are  computable  may  differ. 

In  the  centralized  case  considered  in  Theorems  5.1  and  5.2,  the  failures  considered  axe 
those  of  individual  sensors  or  actuators.  Therefore,  the  two  centralized  designs  differ  not 
only  in  the  view  taken  of  controller  failure,  and  in  other  technical  terms,  but  also  in  the 
reliability  properties  they  seek  to  guarantee. 

5.4  Example 

For  the  example  in  Section  4.6  reliable  designs  have  been  computed  for  both  the  centralized 
and  decentralized  cases. 

Centralized  designs  reliable  with  respect  to  an  outage  of  each  measurement  were  com¬ 
puted  for  several  values  of  the  design  parameter  a  according  to  the  procedure  given  in 
Theorem  5.1.  Table  5.2  gives  the  actual  H<x,  norms  ||T||oo  of  the  resulting  closed-loop 
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Table  5.2:  norms  for  basic  and  reliable  decentralized  designs. 


E 

no 

failure 

lasic  Desi; 
Vi 

fails 

Vi 

fails 

Reliab 

no 

failure 

to 

Es  o 
-  s 

gn  1 

y% 

fails 

Reliab 

no 

failure 

e  Desi 

y\ 

fails 

gn  2 

V2 

fails 

a  =  20 

3.09 

unstab. 

unstab. 

4.38 

2.90 

2.95 

4.34 

4.68 

4.26 

a  =  16 

3.09 

unstab. 

unstab. 

4.26 

2.78 

2.88 

4.29 

4.46 

4.11 

a=  12 

3.06 

unstab. 

unstab. 

4.06 

2.61 

2.78 

4.21 

4.13 

3.89 

a  =  8 

3.01 

unstab. 

unstab. 

3.76 

2.38 

2.76 

4.12 

3.55 

3.46 

a  =  4 

2.72 

34.28 

unstab. 

3.38 

2.22 

2.48 

a  =  2 

1.95 

4.41 

unstab. 

a*Y~ 

aJY -1  -  X  ?  0 

transfer-function  matrices.  Results  corresponding  to  the  designs  reliable  with  respect  to 
outages  of  y i  and  are  labelled  “Reliable  Design  1”  and  “Reliable  Design  2,”  respectively. 
For  each  design,  results  are  given  corresponding  to  no  sensor  failure,  failure  of  yl5  and  failure 
of  y2.  For  the  sake  of  comparison,  Table  5.2,  includes  Hoa  norms  corresponding  to  the  basic 
centralized  output-feedback  design  given  in  Theorem  4.3. 

Reliable  Design  1  theoretically  guarantees  stability  and  the  closed-loop  //oo-norm  bound 
a  only  for  failure  of  yx,  and  Reliable  Design  2  only  for  failure  of  y2;  but  in  this  example, 
each  reliable  design  gives  stability  and  the  i/oo-norm  bound  in  case  of  a  failure  of  either 
measurement.  In  fact,  a  measurement  failure  would  seem  to  result  in  a  reduced  Hoo  norm 
for  the  closed-loop  system.  This  is  so,  however,  because  a  measurement  failure  removes  from 
consideration  the  corresponding  measurement  noise,  effectively  eliminating  one  column  of 
the  transfer-function  matrix.  More  meaningful  is  a  comparison  of  this  (reduced)  transfer- 
function  matrix  in  the  case  of  a  failure  with  the  corresponding  transfer-function  submatrix  in 
the  base  case.  Such  a  comparison  shows  that  the  H <»  norm  in  case  of  a  failure  is  larger  than 
it  is  when  no  failure  occurs.  For  example,  Reliable  Design  2  for  a  =  8  results  in  the  norms 
Halloo  =  3.55  and  piHoo  =  3.46,  as  shown  in  Table  5.2,  while  the  corresponding  parts  of 
the  base-case  transfer-function  matrix  (after  elimination  of  the  appropriate  columns)  have 
norms  HT^ ||oo  =  3.30  and  UTijloo  =  3.01. 

The  reduced  cost  which  can  be  achieved  by  eliminating  measurements  and  their  corre¬ 
sponding  noise  inputs  does  not  constitute  a  valid  argument  for  discarding  one  measurement 


124 


and  using  the  other  alone.  The  use  of  both  measurements  provides  reliability,  in  that  a  single 
sensor  failure  will  not  result  in  system  instability. 

Note  that  the  solution  of  the  observer-design  ARE  satisfies  the  condition  cx2Y~l  =  X  >  0 
only  when  a  >  4  for  Reliable  Design  1,  or  when  a  >  5  (the  case  a  =  5  is  not  shown) 
for  Reliable  Design  2,  while  solutions  were  computed  for  the  basic  design  with  the  design 
parameter  value  as  small  as  a  =  2.  this  difference  is  an  indication  of  the  tradeoff  between 
reliability  and  performance  guaranteed  by  the  respective  designs. 

For  the  same  example,  a  decentralized  control  design  reliable  with  respect  to  the  failure 
of  Control  Channel  1  was  computed  for  various  values  of  the  design  parameter  a  according 
to  the  procedure  of  Theorem  5.3.  Table  5.3  gives  the  actual  Ha 0  norms  of  the  closed- 


Table  5.3:  norms  for  basic  and  reliable  decentralized  designs. 


B 

no  failure 

asic  Design 
#1  fails 

#2  fails 

Rel 
no  failure 

iable  Desig 
#1  fails 

#2  fails 

a  =  20 

3.63 

unstable 

5.34 

6.95 

6.25 

7.03 

a  —  16 

3.63 

unstable 

5.30 

7.65 

6.38 

7.82 

a  =  14 

3.61 

unstable 

5.28 

8.28 

6.32 

8.59 

tna 

3.59 

unstable 

5.23 

No  solution  to  RLA 

3  found. 

loop  transfer-function  matrices  resulting  when  the  reliable  design  was  computed  for  several 
values  of  a.  Conditions  corresponding  with  no  control  failure,  with  failure  of  Controller  #1, 
and  with  failure  of  Controller  #2  are  given.  For  the  sake  of  comparison,  the  comparison, 
the  comparable  portion  of  Table  5.3,  corresponding  with  the  basic  decentralized  design,  is 
reproduced. 

Table  5.3  shows  that  the  reliable  design  guarantees  stability  and  /foo-norm  bounds  a  in 
spite  of  a  possible  failure  of  Controller  #1.  As  in  the  centralized  case,  the  reduce  i/oo  norm 
in  case  of  a  failure  of  Controller  #1  results  since,  when  Controller  #1  fails,  the  disturbance 
wi  and  the  control  input  u\  are  removed  from  consideration,  eliminating  one  column  and  one 
row  from  the  closed-loop  transfer-function  matrix.  Again,  this  apparent  reduction  in  cost 
does  not  constitute  a  valid  argument  for  discarding  Controller  #1  and  using  Controller  #2 
alone,  since  the  use  of  two  controllers  provides  reliability,  in  that  a  single  controller  failure  will 
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not  result  in  system  instability.  No  solution  was  found  to  the  Riccati-like  algebraic  equation 
for  the  reliable  design  with  a  <  13,  illustrating  again  the  tradeoff  between  reliability  and 
disturbance  attenuation. 


5.5  Strongly  Stabilizing  Designs 

The  designs  given  in  Theorems  5.3  and  5.4  provide  decentralized  control  laws  which  are 
reliable  with  respect  to  controller  outages.  For  the  design  given  in  Theorem  5.3,  all  controllers 
susceptible  to  outages  are  automatically  stable;  however,  for  the  design  given  in  Theorem 
5.4,  the  controllers  must  be  assumed  to  turn  out  stable  for  the  closed-loop  system  to  be 
guaranteed  stable.  It  is  therefore  of  interest  to  develop  designs  which  stabilize  the  plant 
via  a  stable  control  law.  Such  designs  are  referred  to  as  “strongly  stabilizing.”  Strong 
stabilization  has  been  treated  in  [64],  where  a  necessary  and  sufficient  condition  for  the 
existence  of  a  strongly  stabilizing  controller  is  given. 

A  decentralized  design  is  now  developed  to  guarantee  open-loop  stability  of  some  subset  of 
controllers,  without  regard  for  performance  in  case  of  a  controller  outage.  This  design  may  be 
combined  with  that  of  Theorem  5.4  so  as  to  guarantee  beforehand  that  specified  controllers 
will  turn  out  open-loop  stable.  As  a  special  case,  a  sirongiy  stabilizing  centralized  design  is 
also  derived. 

With  the  design  otherwise  as  in  Theorem  4.4,  suppose  Equation  (4.47)  is  replaced  by 


WAtc  +  acW  +  ±-WXcBcBjXcW-  WCjCcW  +  GcG* 
or 

+  (W-  WD)CjCc(W  -  WD)  +  P  =  0. 


(5.55) 


For  any  P  >  0,  the  design  guarantees  closed-loop  stability  and  the  H  —  oo-norm  bound 
||7’||oo  <  a.  The  object  is  to  select  P  >  0  so  that  the  ?th  controller  is  open-loop  stable. 
Rewrite  (5.55)  as 


W(AC  -  LcCc)t  +  (Ac  -  LcCc)W  +  \\VXcBcBtcXcW  +  GCGTC  +  LCL[  +  P  =  0. 

or 


(5.56) 


Recalling  the  definitions  Aac  =  Diag(A0,  Aa, . . . ,  Aa),  ij  =  [I  /.../],  and  Ac  =  Aoc  + 
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IcBBjXc,  rewrite  (5.56)  as 


W(Aoc  -  LcCc)T  +  (Aac  -  LcCc)W  +  —WXcBcBjXcW 

or 

+GCG?  +  LCLTC  +  P  +  lcBBjXcW  +  WXCBCBTIJ  =  0. 
The  i*h  n  x  n  main-diagonal  block  of  (5.57)  is 


W„(Aa  -  LiCif  +  (Aa  -  LiCjWu  +  —(Wix . . .  Wiq)XcBcBjXc 


+GGT  +  LiLj  +  Pa  +  BBjXe  \  +{Wa...  Wiq)XcBcBT  =  0, 


(5.57) 


(5.58) 


where  the  linear  coefficient  (Aa  —  Z/,C;)  is  the  open-loop  dynamic  matrix  of  the  ith  controller. 
To  ensure  that  (j4a  —  L.C.)  will  be  Hurwitz,  let  Pa  =  a2S  =  a2BBT.  Then  (5.58)  becomes 

Wit(Aa  -  LtC,)T  +  (Aa  -  LiCi)Wu  +  GCr  +  L,Lf 


=  (-afl  +  i(W-, . . .  Wiq)XcBe )  aBT  + 


(5.59) 


with  Wa  >  0.  To  see  that  this  is  sufficient  to  guarantee  that  ( Aa  —  L{Ci)  is  Hurwitz,  let 
v  0  satisfy  ( Aa  —  LiC{)Tv  =  Xv.  Then  (5.59)  gives 


2Rz(\)vmWav  +  v*LiLjv  <  0, 


and  hence  Re( A)  <  0.  But  inequality  must  hold  here,  because  Re( A)  =  0  implies  Ljv  =  0, 
and  hence  A^v  =  Xv ,  with  Aa  assumed  Hurwitz. 

Note  that  P„  >  a2S  guarantees  that  the  ith  controller  will  be  stable,  independent  of 
the  other  main-diagonal  blocks  of  P.  Therefore,  several  controllers  may  be  simultaneously 
guaranteed  open- loop  stable  by  selecting  the  main-diagonal  blocks  P„  of  P  to  satisfy  Pa  >  0 
if  the  ith  controller  need  not  be  stable,  and  P„  >  a2S  if  the  tth  controller  must  be  stable. 
Other  blocks  of  P  may  be  chosen  in  any  way  that  makes  P  >  0,  such  as  setting  them  all  to 
0. 

The  following  theorem  summarizes  the  result. 
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Theorem  5.5.  Let  P  be  any  qn  x  qn  matrix  satisfying 


P  >  Diag(Plu. . . ,  Ptt,  0, . . . ,  0), 


where  P,t  =  a2S  for  i  €  {1,2,...,*}.  With  all  assumptions  and  the  design  otherwise  as  in 
Theorem  4.4,  suppose  Equation  (4.47)  is  replaced  by 


WAtc  +  ACW  +  \WXCBC3JXCW  -  WCjCcW  +  GCGTC 

or 

+  (W  -  WD)CjCe(W  -  WD)  +  P  =  0. 


(5.60) 


Then  the  design,  in  addition  to  its  other  properties,  guarantees  that  the  controllers  in  the 
first  t  control  channels  are  all  open-loop  stable. 


The  result  of  Theorem  5.5  is  easily  specialized  to  the  centralized  case.  It  is  important 
to  note,  however,  that  the  solution  W  of  the  Riccati-like  design  equation  with  q  =  1  is  not 
the  same  as  the  solution  Y  of  the  observer  design  ARE  in  the  centralized  case.  Therefore, 
the  reformulation  of  the  design  equations  to  guarantee  strong  stabilization  in  the  centralized 
case  is  not  as  simple  as  that  given  in  Theorem  5.5.  The  following  theorem  gives  the  correct 
formulation. 


Theorem  5.6.  With  all  assumptions  and  the  design  otherwise  as  in  Theorem  4.3,  letY  >  0 
satisfy  the  ARE 

YFt  +  FY  +  ArYHTHY  -  YCTCY  +  1-YXSXY  +  GGT  +  a2S  =  0,  (5.61) 

a*  a2 

where  F  =  A  —  SX ,  S  =  BBT .  Then  the  system  is  strongly  stable,  and  the  closed-loop 
transfer-function  matrix  satisfies  HTHc  <  a. 

Proof.  For  the  special  case  q  =  1,  the  strong  stabilization  result  of  Theorem  5.5  still  holds. 
In  this  case,  the  design  equation  (5.60)  is 

W(A  +  ot~2GGTX)r  +  {A  +  a~2GGTX)W  +  —WXSXW 

a  (5.62) 

-  WCTCW  +  GGT  +  a2S  =  0. 
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Hence,  the  proof  consists  of  showing  that  (5.61)  implies  (5.62).  Recall  the  assumption  from 
Theorem  4.3  that  <  a2  or  (a2K-1  -  X)  >  0.  This  implies  that  there  exists  a 

matrix  W  >  0  such  that 

W-i  _  Y- »  _  q~2X. 


Then,  routine  manipulations  of  (5.61)  give  the  equivalent  equation 

YAt  +  AY  +  X:YHtHY  -  YCtCY  +  GGT  +  a2YW~xSW~lY  =  0. 

a2 

Pre-  and  post-multiply  (5.64)  by  Y~l,  and  use  (5.63)  to  obtain 

AT(a~2X  +  W')  +  (a~2X  +  W~')A  +  {a-2X  +  W-')GGT{a-2X  +  W~') 

+  ~HTH -CTC  +  a2W~1SW-1  =0. 
a 2 


(5.63) 


(5.64) 


(5.65) 


Now,  divide  the  state- feedback  design  ARE  (4.3)  by  a 2  to  obtain 


1 


AT(a-2X)  +  ( a~2X)A  +  ( a~2 X)GGr {a~2 X )  -  jfXSX  +  -^H lH  =  0, 

and  subtract  (5.66)  from  (5.65)  to  obtain 

AtW~  1  +  W-'A  +  {a-2X)GGTW-1  +  W-1GGT(a~2X) 

+  W-'GGtW -1  -  CTC  +  4 XSX  +  oc2W-xSW~x  =  0. 

a 1 


(5.66) 


(5.67) 


Finally,  pre-  and  post-multiply  (5.67)  by  W,  and  rearrange  terms  to  obtain  (5.62).  □ 
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6  EXTENSIONS 

6.1  Robust  Decentralized  Control 

The  decentralized  design  methodology  given  in  Section  4.7.3  is  now  extended  to  apply  to 
a  plant  with  structured  (parametric)  uncertainty.  The  resulting  designs  guarantee  robust 
stability  and  an  /foo-norm  bound  for  the  closed-loop  system,  for  any  plant  uncertainty  in  a 
bounded  admissible  set. 

The  results  and  methods  applied  to  the  study  the  robust  control  problems  of  interest  here 
are  closely  connected  to  the  topics  of  quadratic  stability,  and  to  //oo-norm  optimization. 
Among  the  relatively  few  papers  that  actually  treat  the  problem  of  robust  /foe-bounding 
control  in  the  presence  of  structured  parametric  uncertainty  is  [65],  where  a  perturbations 
in  (A,  B,  C)  is  represented  as  additional  weighted  noise  inputs  and  measured  outputs.  The 
procedure  suggested  in  [66]  is  then  followed  to  solve  the  problem.  As  a  consequence  of  the 
selected  linear  and  quadratic  bounding  function  a  controller  is  defined  via  three  coupled 
Riccati-like  equations.  The  procedure  developed  here  is  in  the  same  spirit,  but  with  the 
restriction  of  plant  variations  in  the  A  matrix  only.  The  applied  approach,  which  in  essence 
implies  a  different  bounding  procedure,  leads  to  two  decoupled  design  equations. 

The  results  are  of  interest  is  particular  because  they  explain  to  the  decentralized  control 
case,  but  they  also  apply  easily  to  the  simpler  state-feedback  and  centralized  output-feedback 
cases,  which  are  omitted  here. 

Structured  uncertainty  is  introduced  into  the  plant  A-matrix  according  to  the  definition 

A  =  A0  +  Y^GkMkHk,  (6.1) 

k=i 

where  A0  is  known,  the  Gk  s  and  s  give  the  structure  of  the  uncertainty,  and  each  unknown 
constant  matrix  M*  satisfies 

'  max  { <  <r\.  (6.2) 

If  each  positive  bound  <7*  is  sufficiently  small,  then  the  design  equations  to  be  derived  for  ro¬ 
bust  control  will  have  appropriate  solutions.  The  existence  of  such  solutions  guarantees  that 
the  computed  control  law  provides  the  desired  robust  stability  and  disturbance  attenuation. 


130 


6.1.1  Robust  design  derivation 

The  derivation  of  the  robust  design  methodology  is  similar  to  that  of  the  reliable  design 
methodology  given  in  Section  5.  The  essential  idea  of  the  derivation  is  to  formally  express 
a  sufficient  condition  for  stability  and  disturbance  attenuation  for.  the  nominal  system,  in¬ 
cluding  a  formed  representation  of  some  design  freedom,  and  to  determine  how  to  use  that 
freedom  to  guarantee  robust  stability  and  performance  for  the  actual  system. 

The  first  step  in  the  derivation  is  to  fix  the  observer  structure  of  the  control  law,  and 
write  the  desired  condition 

FlXe  +  XeF0e  +  —XeGcGTtXt  +  Hj  He  +  Pe  =  0,  (6.3) 

or 

where  (Foe,Ge,  He)  describes  the  nominal  closed-loop  system,  and  Pe  >  0  is  as  yet  unspeci¬ 
fied.  An  appropriate  value  of  Pe  will  be  chosen  to  guarantee  desired  robustness  properties. 
The  plant  uncertainty  terms  are  omitted  in  (6.3),  so  that 

A,  -BBTX'  \ 


(  Ao  -BBJXC 
\  LcC  Aoac  —  LcCc 


where  Aq  represents  the  nominal  plant  dynamics,  and  the  block-diagonal  matrix  A0ac  —  LcCc 
represents  the  dynamics  of  the  decentralized  control  law  to  be  determined.  Taking  into 
account  the  plant  uncertainty  (6.1),  the  actual  closed-loop  dynamic  matrix  is  given  by 


Fe  =  Foe  + 


5(°‘) 


Mk(Hk  0)  =  Foe  +  T,GekMkHek. 


Using  (6.4),  rewrite  the  condition  (6.3)  as 

Fjx,  +  X,F,  +  -4 X,G,G*X,  +  HjH,  =  -Pc  +  (F,  -  F^f  X,  +  X,(F,  -  F„.) 


=  -ft  +  +  X'G'kMkHek}’ 

k=l 

Now,  Pe  >  0  may  be  chosen  such  that  the  right-hand  side  of  (6.5)  is  negative  semi-definite. 
Recall  that  <rk  is  given  by  (6.2),  and  set 

ft  =  +  4X,G,„GlX,}  >  '£{HjtH,k  +  X,G.kM„MjGTtiXt),  (6.6) 

l  =  fc  fcs  1 
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so  that,  after  some  manipulation,  (6.5)  gives 

FT  Xe  +  XeFe  +  ~XeGeGjXe  +  HjHe 


=  -  X,GkkMk){H,k  -  MkG*kX') 

k- 1 


(6.7) 


-  MkMTk  )GT,kXk}  <  0. 

1 

Therefore,  if  ATe  >  0  satisfies  (6.3),  with  Pe  given  by  (6.6),  then  the  uncertain  system  satisfies 
the  main  hypothesis  of  Lemma  2.1. 

The  next  step  in  the  derivation  of  the  robust  control  is  to  determine  the  needed  mod¬ 
ifications  to  the  design  equations  (4.28)  and  (4.44)  so  that  Xe  >  0  satisfies  (6.3),  with  Pe 
given  by  (6.6).  By  examination  of  (6.3)  and  (6.6),  and  of  the  definitions  of  Ge  and  He  given 
in  (4.34),  it  is  easily  seen  that 

ijf.G.GlX  +  HjH,  +  Pk  =  ±  X,Gk+GlXk  + 


where 


£  ^>G+  =  (C;  tx<T\Gx  ...  a<rrGr), 


(6.8a) 


H, 


e+ 


(  H  \ 

6*5 

+ 

o 

,tf+  = 

Hx 

V  o  -Bjx c) 

<  Hr 

(6.86) 


Hence,  the  robust  design  is  obtained  by  replacing  the  triple  ( A,G,H )  with  the  triple 
(Aq,G+,  H+)  in  the  design  equations  (4.28)  and  (4.44)  for  the  basic  design.  Using  the 
augmented  matrices  G+  and  H+  in  the  design  equations  is  similar  to  introducing  additional 
disturbance  inputs  and  regulated  outputs  into  the  problem.  Therefore,  the  smallest  value 
of  a  for  which  the  design  equations  will  have  a  solution  will  be  larger  for  the  robust  design 
than  for  the  basic  design. 

Recall  that,  in  the  basic  design,  the  controller  dynamics  depend  on  an  assumed  worst 
disturbance,  and  hence  on  the  matrix  G.  Therefore,  replacing  G  with  G+  in  the  design 
affects  not  only  Ge,  but  also  Foe- 
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The  final  step  in  deriving  the  robust  design  is  to  establish  that  (Fe,  He )  is  a  detectable 
pair.  Note  that  Lemma  4.2,  applied  to  the  modified  design,  establishes  that  (F^,  He+)  is 
a  detectable  pair,  provided  (Ao,H)  is  a  detectable  pair,  Aoa  =  AQ+a-iG+G*X  —  SX  is 
Hurwitz,  and  Aq0  +  SX  has  no  ju- axis  eigenvalues.  Let  u  ^  0  satisfy 

Fev  =  Au,  Hev  =  0.  (6.9) 

The  detectability  proof  consists  of  proving  that  Re(A)  <  0.  Multiply  (6.7)  on  the  left  by  u* 
and  on  the  right  by  v  to  obtain 

2Re(A)u*Xeu  +  —2vX<GtGlXtv  +  ;*{/£  -  XeGekMk}{Hek  -  MlGTtkXt}v 

Q  k=i 

(6.10) 

+j2v-{X,G,k(lrlI  -  MkMl)GlX')v  <  0. 

Since  every  term  in  (6.10)  but  the  first  is  nonnegative,  this  implies 


Re(A)u*A>  <  0.  (6.11) 

If  inequality  holds  in  (6.11),  then  v*Xev  >  0  and  Re(A)  <  0.  If  equality  holds,  then  every 
term  in  (6.10)  is  zero.  This  gives 

{ Hek-MlGl'Xe}v  =  0 ,  k  6  {1,2,.. .,r}.  (6.12) 

But,  since  (6.2)  implies  <r\I  —  MkM%  is  nonsingular,  (6.10)  also  gives  G*kXev  =  0,  so  that 
(6.12)  gives 

Hekv  =  0,  *€{l,2,...,r}.  (6.13) 

Hence,  (6.4)  and  (6.9)  give  Foev  =  Au,  while  (6.8b)  and  (6.9)  give  Hj+He+v  =  0.  Since 
(F0e,He+)  is  a  detectable  pair,  this  implies  Re(A)  <  0. 


Theorem  6.1  summarizes  the  result.  The  following  definitions  are  convenient: 

Aoac  —  Diag  (/4oa,i4oa,-..,i4oo),  (6.14a) 

A0a  =  Aq  +  -^G+GlX  -  SX,  (6.146) 
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(6.14c) 
(6.14  d) 


Aqc  =  Aoac  -f-  IcBBjXc, 

Gc+  =  ICG+. 

ij  =  [/  /  ...  J]e2Rnx,n. 

Theorem  6.1.  Suppose  the  plant  (2.1 ),  with  decentralized  control  structure  given  by  (4.26), 
has  constant  structured  uncertainty  (6.1),  with 

<  Ok,  k  €  {1,2, ..  .,r}. 

Define  G+  and  H+  as  in  (6.8),  and  let  X  >0  satisfy 

AlX  +  XAo  +  LxG+GlX  -  XSX  +  =  0,  (6.15) 

and  W  >  0  satisfy  the  Riccati-like  algebraic  equation 

WAl+  AocW  +  WXcBcBj XCW  -  WCTc  CcW 

a  (6.16) 

+GC+G?+  +  (W  -  WD)C?Ce(W  -  WD)  =  0. 

Suppose  also  that  (A0,  H )  is  a  detectable  pair,  Aoa  is  Hurwitz,  and  Aqc  +  SX  has  no  eigen¬ 
values  on  the  ju-axis.  Then  the  decentralized  control  law 

ii  =  (Ak»  —  LiCi)£i  +  Liy,,  i  €  {1,2, ...  ,g}, 

u,  =  -BTx( i,  ie  {1,2,. 

with  Li  =  WuCj ,  i  €  {1,2,..., 9},  robustly  stabilizes  the  uncertain  plant,  and  the  closed- 
loop  transfer-function  matrix  T(s)  from  we  to  z  satisfies 

nice  <  a. 

There  is  no  explicit  restriction  on  the  size  of  the  bounds  Ok  in  Theorem  6.1.  However,  the 
larger  the  cr*’  s  are  taken  to  be,  the  larger  a  will  need  to  be  to  obtain  solutions  to  the  design 
equations  (6.15)  and  (6.16);  if  the  <t*’s  are  taken  to  be  too  large,  no  solutions  may  exist  at 
all.  If  bounds  Ok  on  the  size  of  the  uncertainty  are  known  accurately,  then  these  bounds 


134 


should  be  incorporated  in  G+  (or  H+),  and  hence  in  the  design  equations.  If  the  resulting 
design  equations  can  be  solved,  then  the  design  can  tolerate  uncertainties  of  the  specified 
size.  On  the  other  hand,  if  uncertainty  bounds  are  not  accurately  known,  the  choice  of  the 
ait's  may  be  used  to  reflect  a  relative  weighting  to  be  given  by  the  design  to  disturbance 
attenuation  and  robustness  considerations.  Since  changing  the  values  of  the  a^s  in  this  case 
is  equivalent  to  rescaling  the  Gk  s  and  Hk's  while  holding  the  <7fc’s  fixed,  it  may  simplify  the 
design  procedure  to  set 

ak  =  -,  k  €  {1,2,. ..,r}, 
a 

and  scale  the  Gk's  and  Hk's  with  respect  to  G  and  H  so  as  to  reflect  the  tradeoff  between 
robustness  and  disturbance  attenuation.  Then,  the  size  of  the  uncertainty  which  may  be 
tolerated  is  determined  indirectly  by  finding  the  smallest  value  of  a  for  which  the  design 
equations  can  be  solved.  This  variation  on  the  above  design  is  given  in  Theorem  6.2. 

Theorem  6.2.  Suppose  the  plant  (2.1),  with  decentralized  control  structure  defined  by 
(4.26),  has  constant  structured  uncertainty  (6.1),  with 

^{MkMj}  <  -1 

or 

Define  G+  =  (G  Gi  ...  Gr)  and  H+  =  ( HT  H{  . . .  H?').  Let  X  >  0  satisfy  (6.15)  and  let 
W  >  0  satisfy  the  Riccati-like  algebraic  equation  (6.16).  Suppose  also  that  (Aq,  H)  is  a 
detectable  pair,  /f0a  is  Hurwitz,  and  A0a  +  SX  has  no  eigenvalues  on  the  ju-axis.  Then  the 
decentralized  control  law 


=  Moa  —  LiQ)ti  +  Liyi,  i  €  {1,2, ...  ,q}, 

Ui  =  -BfXti,  i  €  {1,2,...,?}, 

with  L,  =  WuCj ,  i  €  {1,2,...,?},  robustly  stabilizes  the  uncertain  plant,  and  the  closed- 
loop  transfer-function  matrix  T(s)  from  we  to  z  satisfies 

imioo  <  a. 
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6.1.2  Example 


This  section  presents  an  example  of  robust  state-feedback  control  design.  The  example 
illustrates  the  difference  between  the  robust  designs  of  Theorems  6.1  and  6.2,  and  the  use 
of  the  parameter  ox  to  determine  the  largest  uncertainty  in  a  certain  class  for  which  the 
design  guarantees  stability  and  the  predetermined  H^-norm  bound.  For  these  purposes,  a 
state-feedback  example  is  adequate,  and  has  the  advantage  of  avoiding  the  complication  of 
decentralized  design,  already  studied  in  Section  4. 

Consider  nominal  plant 


f  “2 

1 

1 

1  \ 

(  0 

°\ 

3 

0 

0 

2 

B  = 

1 

0 

-1 

0 

-2 

-3 
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0 

l  -2 

-1 

2 

-1  ) 

l  0 

1  / 

(l\ 

0 

1 

0  / 


-10), 


and  introduce  the  structured  uncertainty 


A  —  Aq  +  G\MXH\, 


where  M\  is  an  unknown  scalar,  and  G\  and  H\  are  given  by 


Gi  = 


0  \ 
0 
0 
1 


,  Hx  =  (0  0  1  0) . 


(6.17) 


This  represents  an  uncertainty  in  the  (4,3)  element  of  the  A-matrix  of  the  plant.  As  in  the 
decentralized  design  of  Theorem  6.1,  the  robust  state- feedback  control  is  found  by  doing  a 
basic  design,  but  with  the  augmented  matrices  G+  and  H+  in  place  of  G  and  H,  where  in 
this  case 


/ 1 

0  \ 

0 

0 

II 

tcT 

f  1  0 

O 

1 

1 

0 

^  0  0 

1  o) 

V  0 

a<7i  j 

f 

The  state-feedback  design  equation  becomes 


AqX  +  XAo  +  \XG+G\X  -  XSX  +  HT+H+  =  0, 

Q 
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or  equivalently 


AZX  +  XAq  +  ^ XGGtX  +  (T*XGiGjX  -  XSX  +  HtH  +  HfHx  =  0.  (6.18) 

In  the  second  quadratic  term  of  (6.18),  the  a’s  cancel  out,  allowing  computation  of  a  solution 
for  a  =  oo.  By  setting  a  =  oo  and  solving  (6.18)  with  various  values  of  oq,  one  may  determine 
a  largest  plant  perturbation  (corresponding  with  |Afi|  =  crim„)  for  which  at  least  stability 
can  be  guaranteed  using  the  robust  state-feedback  design.  Then,  given  any  C\  <  erlmM, 
one  may  determine  a  number  oti„in  such  that  for  any  a  >  or,^  there  exists  an  appropriate 
solution  of  (6.18),  and  therefore  an  associated  design  guaranteeing  the  robust  i/oo-norm 
bound  ||T||oo  >  a  f°r  the  closed-loop  system.  Table  6.1  gives  the  values  of  anun>  to  the  nearest 
0.1,  computed  for  various  values  of  ax,  and  shows  clearly  the  tradeoff  between  robustness  and 
optimal  disturbance  rejection.  In  this  example,  the  largest  admissible  plant  perturbation  is 
given  approximately  by  <7im„  =  1.8. 

Table  6.1:  Approximate  minimum  //oo-norm  bounds  for  various  plant  uncertainties. 


01 

1.0 

1.2 

1.4 

1.6 

1.8 

*-*min 

1.4 

1.5 

1.6 

1.8 

3.0 

If  <r !  =  a-1,  as  in  Theorem  6.2,  then  for  Gi  and  H\  given  by  (6.17)  the  design  equation 
becomes 

a£X  +  XAo  +  ^ X{GGt  +  GiGj)X  -  XSX  +  HTH  +  H^Hx  =  0.  (6.19) 

The  approximate  smallest  value  of  a  for  which  (6.19)  has  an  appropriate  solution  is  amin  = 
1.4,  which  corresponds  with  a  plant  uncertainty  bound  —  0.71. 

6.2  Computation  of  Families  of  H0 0  Control  Laws 

6.2.1  Introduction 

Given  a  set  of  control  design  requirements,  a  designer  may  wish  to  characterize  a  family 
of  control  laws  which  satisfy  these  requirements.  The  characterization  of  a  family  of  such 
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admissible  control  laws  may  permit  the  selection  of  a  particular  controller  with  additional 
desirable  properties. 

Youla  et  al.  [67]  give  a  parameterization  of  all  stabilizing  controllers  in  terms  of  sta¬ 
ble  coprime  factorizations  of  the  plant  and  a  baseline  stabilizing  controller.  The  parameter 
space  consists  of  the  set  of  all  stable  proper  transfer- function  matrices  Q(s)  of  appropri¬ 
ate  dimensions.  Doyle  et  al.  [1]  and  Glover  and  Doyle  [47]  give  a  parameterization  of  all 
stabilizing  controllers  which  provide  the  i/oo-norm  bound  ||T||oo  <  a  for  the  closed-loop 
transfer-function  matrix  T(s).  The  parameter  space  consists  of  the  set  of  all  stable  proper 
transfer-function  matrices  Q(s)  of  appropriate  dimensions  satisfying  ||Q||oo  <  a.  The  con¬ 
troller  parameterizations  given  in  [67],  [1],  and  [47]  have  the  advantage  of  spanning  the 
set  of  all  controllers  with  the  desired  (stabilization  or  disturbance-attenuation)  properties. 
Unfortunately,  they  have  two  substantial  disadvantages:  First,  they  include  controllers  of 
arbitrarily  high  order;  second,  they  do  not  retain  the  structural  properties  of  the  baseline 
controller,  such  as  strict  properness  or  decentralized  control  structure.  Restricting  the  order 
of  the  parameter  Q(s)  also  bounds  the  order  of  the  controller;  however,  structural  properties 
of  the  baseline  controller  are  still  not  retained. 

Based  on  the  parameterization  of  Youla,  [68]  gives  a  characterization  of  all  stabilizing 
decentralized  control  laws.  The  approach  is  simply  to  restrict  the  Youla  parameter  Q(s)  to 
values  which  give  control  laws  with  block-diagonal  structure.  This  restriction  is  shown  to  be 
equivalent  to  a  set  of  matrix  algebraic  constraints  on  the  parameter.  Unfortunately,  there 
is  no  clear  way  of  selecting  the  parameter  to  satisfy  these  constraints.  Even  if  appropriate 
parameters  could  be  found,  the  corresponding  controllers  would  still  not  retain  the  order  or 
strict  properness  of  the  baseline  controller. 

This  section  gives  a  characterization  of  families  of  //oo-suboptimal  control  laws  starting 
from  known  baseline  designs.  The  derivation  of  the  baseline  controllers  in  each  case  has  been 
accomplished  in  Section  4  by  fixing  a  controller  structure  and  selecting  controller  parameters 
such  that  a  certain  algebraic  Riccati  equation  (ARE),  with  closed-loop  system  matrices  as 
coefficients,  has  a  positive  semi-definite  solution.  In  this  paper,  families  of  controllers  are 
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derived  by  retaining  the  baseline  controller  structure  and  finding  controller  parameters  such 
that  a  relaxed  sufficieni  condition,  in  the  form  of  an  algebraic  Riccati  inequality,  is  satisfied. 
Suitable  controller  parameters  are  found  by  exploiting  a  convexity  property  of  a  matrix 
Riccati  function. 

First,  a  family  of  state- feedback  gains  all  of  which  guarantee  the  same  //oo-norm  bound 
is  given.  Then,  a  family  of  observer- based  output-feedback  controllers  is  given,  based  on 
some  member  of  the  state-feedback  family.  Each  member  of  the  output-feedback  family 
has  the  same  observer  structure;  therefore,  each  is  strictly  proper  and  is  of  the  same  order 
as  the  plant.  Finally,  a  family  of  decentralized  control  laws  is  derived  in  the  decentralized 
case,  where  the  baseline  controller  contains  a  full-order  observer  of  the  plant  in  each  control 
channel.  Again,  the  (strictly  proper)  observer  structure  and  the  controller  order  are  retained 
by  each  member  of  the  family. 

No  claim  is  made  that  the  families  of  controllers  given  here  include  every  controller  with 
the  desired  characteristics;  however,  the  families  are  easily  computed,  and  exclude  all  non- 
strictly  proper  and  high-order  controllers. 

6.2.2  The  matrix  Riccati  function 

This  section  gives  some  properties  of  a  matrix  Riccati  function  related  to  the  computation 
of  families  of  /foo-suboptimal  control  laws.  The  matrix  Riccati  function  is  studied  in  greater 
detail  in  [10]. 

Define  the  matrix  Riccati  function  R  on  the  space  of  symmetric  matrices  by 

R{X)  =  FtX  +  XF+  \XGGTX  +  HtH.  (6.20) 

a 2 

Then  the  following  property  is  easily  verified: 

Lemma  6.1.  Suppose  F  is  Hurwitz  and  R(X)  =  0.  Then  X  >  0. 

Proof.  Write  out  R(X)  =  0  as 

R(X)  =  FtX  +  XF  -(-  ~XGGtX  +  HtH  =  0.  (6.21) 
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Define  P  =  a'2 XGGT X  +  HT H .  Then  (6.21)  becomes  FTX  +  XF+  P  =  0,  with  F  Hurwitz 
and  P  >  0.  By  inertia  theorems  of  the  Lyaunov  equation  (see,  for  example,  [20],  X  >  0  □ 
The  following  lemma  gives  a  matrix  convexity  property  for  R.  This  property  does  not 
require  that  F  be  Hurwitz,  but  only  that  the  quadratic  coefficient  be  positive  semi-definite. 

Lemma  6.2.  For  i  6  {1, . . .  ,r},  let  Xt  be  symmetric  matrices  and  fa  be  nonnegative  scalars 
satisfying  E{=lfa  =  1.  Then 

<E0.R(X.)-  (6.22) 

V.=l  J  «=1 

Proof.  Compute 

R  jgftA-j  =  Ft  {£/**,}  +  {SAX,}  F  +  i  {£&*}  GGt  {£>*}  +  HtH 

=  '£»,(FTX,  +  X.F  +  HtH)  +  \Y.i^M,X.GGTX, 

.=1  Q  1=17=1 

=  ±mx.)  -  !3.X.GGTX.  ( ±0,)  +  j£±jM,Xfi&Xi 

,=1  °  .=1  [j=l  )  “  »=lj=l 

=  t.0,R{x.)  -  4  E  'Lm,x.ggt(x.  -  Xj) 

.=1  a  i=l  7=1 

=  ±  ±  £  M jXtGG7^  -  X-) 

«=1  ^  1=1  7=1 

E M,x.ggt(x, - x,) 

Q  ,=  i  j=i+i 

=  £>*(*) -ttii  mX<GGT(X i  -  Xj) 

1=1  Q  1=1  7  =  1 


E  E  mx,GGT(x.  -  Xj) 

i-l  7=1 

=  E>fl(x.)  -  E  E  E  MW  -  Xj)GGT(Xi  -  Xj). 

t=l  a  ,=i  j= i 

(6.23) 
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Therefore,  R  {T,rt=l0iR(Xi)}  <  y^j3jR(Xt),  the  desired  result.  □ 

i=i 

The  following  corollary  identifies  a  class  of  easily  computable  matrices  Z  >  0  for  which 
R{Z)  <  0: 

Lemma  6.3.  Let  Z  be  any  convex  combination  of  matrices  X{  >  0,  i  €  {l,2,...,r}, 
satisfying  R(Xi)  =  0. 

Then  Z  >  0  satisfies 

R(Z)  <  0.  (6.24) 

Proof.  Express  Z  as 

z = 

i= 1 

where  E[=1/?,  =  1.  From  Lemma  6.1  Z  >  0,  and  from  Lemma  6.2, 

R(Z)  =  R  2  EiWW  =  0. 

□ 


6.2.3  A  family  of  state-feedback  controls 

Note  that,  for  the  state-feedback  case,  any  matrix  X  >  0  satisfying  (4.8)  is  suitable  for 
computing  the  control  u  =  —BTXx.  In  fact,  this  control  would  still  be  suitable  if  the 
left-hand  side  of  (4.8)  were  negative  semi-definite;  that  is,  any  control  law  given  by 

u  =  - BTZx ,  (6.25) 

AtZ  +  ZA+  \ZGGTZ  -  ZBBTZ  +  HtH  <0,  Z  >  0  (6.26) 

or 

provides  stability  and  the  /foo-norm  bound  a  for  the  closed-loop  system. 

A  given  solution  X  >  0  of  (4.8)  will  be  called  the  “baseline”  solution.  Given  one  such 
solution,  a  family  of  matrices  Z  >  0  satisfying  (6.26),  and  hence  a  family  of  stabilizing  state- 
feedback  control  laws  which  guarantee  the  closed-loop  bound  ||T,||00  <  a,  is  characterized. 
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Take  X  >  0  to  be  the  baseline  solution  of  (4.8).  Given  this  fixed  matrix  X,  define  the 
matrix  Riccati  function  R  by 

R(M)  =  FtM  +  MF+  \MGGTM  +  {XBBTX  +  HTH),  (6.27) 

or 

where  F  =  A  —  BBT X  is  Hurwitz.  By  Lemma  6.1,  each  symmetric  solution  of  R(Xi)  =  0 
satisfies  X{  >  0.  Let  Z  >  0  be  any  convex  combination  of  solutions  X,  of  R(-X’j)  =  0.  By 
Lemma  6.3, 

R(Z)  =  FtZ  +  ZF+  —?ZGGtZ  +  (XBBrX  +  HTH )  <  0.  (6.28) 

a1 

To  see  that  Z  >  0  satisfies  (6.26),  rearrange  (6.28)  to  obtain 

ATZ  +  ZA+  ~ZGGtZ  -  ZBBtZ  +  HTH 
a 2 

<  -ZBBTZ  +  ZBBTX  +  XBBTZ  -  XBBTX 
=  -{Z  -  X)BBT{Z  ~  X)  <0. 

The  following  theorem  summarizes  the  characterization  of  a  family  of  state-feedback  H <*, 
controls: 

Theorem  6.3.  Suppose  F  =  A  —  BBT  X,  where  X  >  0  solves  the  state- feed  back  design 
ARE  (4.8).  Let  Z  be  any  convex  combination  of  solutions  X{  of  the  ARE 

FTXi  +  XiF  +  \XiGGTXi  +  (XBBtX  +  HTH)  =  0.  (6.29) 

or 

Then,  Fz  —  A  —  BBT Z  is  Hurwitz,  and  the  state-feedback  control  law 

u  =  —BTZx 


guarantees  that 

TM  =  (  _gTZ  )  -  Fz)-'G 

satisfies  ||T’|j0o  <  or. 
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6.2.4  A  family  of  output-feedback  controls 


The  approach  of  Theorem  6.3  extends  to  the  output-feedback  case:  Start  with  Z  >  0  a 
convex  combination  of  solutions  A,  of  (6.29).  Define 

Ni  =  ATZ  +  ZA+  -r ;ZGGtZ  -  ZBBtZ  +  HTH.  (6.30) 

a3 

By  Lemma  6.3,  Nx  <  0.  The  following  theorem  now  gives  a  family  of  observers  for  each 
state- feedback  control  characterized  by  such  a  Z. 

Theorem  6.4.  Assume  A  +  a~2GGTZ  —  BBTZ  is  Hurwitz.  Let  Y  >  0  satisfy 

AY  +  YAt  +  ~YHtHY  -  YCtCY  +  GGT  =  0,  (6.31) 

a3 

with  (A  —  YCTC)  Hurwitz.  Let  V  >  0  be  any  convex  combination  of  solutions  Y,  of 
(A  -  YCtC)Y  +  Y,(A  -  YCrC)T  +  -4 Yi(HTH  -  Nx)Yt  +  ( YCTCY  +  GGT)  =  0  (6.32) 

a 1 

satisfying  <rmAX {VZ}  <  a2,  and  define  the  observer  gain  L  by 


L  =  (/  -  a~2VZ)-lVCT  =  (V1  -  a~2Z)~1CT. 

(6.33) 

Then,  the  controller 

£  =  (a  +  ^GGTZ  -  BBtZ  -  LC'j  (  +  Ly , 

(6.34a) 

u  =  -BTZi, 

(6.346) 

stabilizes  the  plant  (2.1),  and  provides  the  closed-loop  Hoo-norm  bound  ||T||oo  £  Q- 
Proof.  First  note  that,  since  Ni  <  0,  (HT H  —  N{)  >  0.  By  Lemma  6.3, 

(A  -  YCrC)V  +  V(A  -  YCtC)t  +  V{HtH  -  Nt)V  +  ( YCTCY  +  GGT)  <  0.  (6.35) 

Algebraic  manipulations  similar  to  those  in  the  proof  of  Theorem  3.1  give 

AV  +  VAt  +  \VHTHV  -  VCTCV  +  GGt  <  \VNX V.  (6.36) 

a3  a2 
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(6.37) 


Pre-  and  post-multiply  (6.36)  by  qF_1  to  obtain 


(ot2V-1)  +  i4T(a2V’_1)  +  HtH  -  a2CTC  +  \{orV~x)GGT  {a2V~x)  <  Nx. 


Subtract  (6.30)  from  (6.37)  to  obtain 

(a2^-1  -  Z)A  +  AT(a2V~l  -  Z)  -  a2CTC 


+i_(a2 V-1)GGt(q2V~1)  +  ZBBtZ  -  ZGGTZ  <  0. 


(6.38) 


Define 


Xt  =  {a2V~x  -Z)>  0, 


(6.39) 


and  rewrite  (6.38)  as 


XiA  +  ATXl  -  a2CTC  +  -L{Xx  +  Z)GGT(Xl  +  Z)  +  ZBBtZ  -  \ZGGTZ  <  0.  (6.40) 


Now  define  Ni  <  0  as  the  left-hand  side  of  (6.40);  rearranging  terms,  (6.40)  becomes 

N2  =Xi(A  +  or2GGTZ  -  LC )  +  {A  +  or2GGTZ  -  LC)X1 


+a2CTC  +  A:X1GGTXl  +  ZBBtZ  <  0. 

cr 


(6.41) 


With  the  controller  (6.34),  the  closed-loop  system  transformed  to  error  coordinates  is  de¬ 
scribed  by 


n  _(  A-  BBtZ  -BBtZ 

<e  “  V  cr2GGTZ  A  +  cr2GGTZ  -  LC 


)'G'=(-G  Jtz  ) 


Define 


and  consider  the  quantity 


*-=(o  £)-0’ 


X,F,  +  FjX,  +  -Lx.G.G^X.  +  HjHt. 


(6.42) 


It  can  now  be  verified  that  the  two  off-diagonal  blocks  of  (6.42)  are  identically  zero,  and  that 
the  diagonal  blocks  give  Ni  and  N2,  as  defined  in  (6.30)  and  (6.41);  therefore, 

X,F,  +  Fj Xt  +  ^X,G,GT,X,  +  HjH.  =  (  ^  M  <  0. 
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The  proof  of  detectability  of  ( Fe ,  He)  is  routine,  and  proceeds  exactly  as  that  in  Section  4.4. 
Therefore,  by  Lemma  4.1,  Fe  is  Hurwitz,  and  T(s)  =  He(sl  —  Fe)~lGe  satisfies  ||T,||00  < 

а. 

□ 

Recall  that  [48]  and  [47]  give  parameterizations  of  the  set  of  all  output-feedback  controllers 
guaranteeing  the  /foo-norm  bound  a.  Some  of  these  controllers  axe  of  high  order,  and  are 
therefore  undesirable.  By  contrast,  Theorem  6.4  characterizes  a  family  of  controllers  with 
realizations  all  of  the  same  order  as  the  plant,  which  all  guarantee  the  i/oo-norm  bound  a. 

б. 2.5  A  family  of  decentralized  controls 

A  generalization  of  Theorem  6.4  to  the  decentralized  case  cannot  be  readily  obtained. 
Manipulations  like  those  in  the  proof  of  Theorem  6.4  applied  to  the  Riccati-like  (decentral¬ 
ized)  design  equation  do  not  give  the  desired  result.  Therefore,  while  Theorem  6.4  gives  a 
family  of  observer  designs  for  each  state- feedback  design,  the  next  theorem  gives  only  one 
decentralized  observer  design  for  each  state-feedback  design  of  Theorem  6.3.  The  definitions 
of  Z  and  Ni  assumed  in  the  theorem  statement  are  as  in  Section  6.2.4.  For  the  remainder 
of  this  section,  every  occurrence  of  X  in  (4.35)  is  replaced  by  Z. 

Theorem  6.5.  Assume  A  +  a~2GGTZ  —  BBTZ  is  Hurwitz  and  A  +  q~2GGtZ  has  no 
ju>-axis  eigenvalues.  Let  W  >  0  satisfy  the  Riccati-like  algebraic  equation 

ACW  +  WAtc  +  \wXcBcBtcXcW  -  WCjCcW  +  GcGtc  +  (W  -  WD)C*Cc{W  -  WD)  =  0, 
or 

(6.43) 

and  compute  Lc  =  Diag{L\,  Lj, . . . ,  Lq)  as 

Lc  =  WDCj.  (6.44) 

Then,  the  decentralized  control  law 

ii  =  {A+ —GGT Z  —  BBT Z  —  LiCi)£i  + Liyi,  i  €  {1,2, . . .  ,q},  (6.45a) 

ui  =  —Bj Z£i,  i  €  {1,2, ...  ,9},  (6.456) 
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stabilizes  the  plant  (2.1),  with  decentralized  control  structure  given  by  (4.26),  and  provides 
the  closed-loop  H^-norm  bound  UTH^  <  a. 


Proof.  Using  (6.44),  rewrite  (6.43)  as 


1 


-  LcCc)W  +  W(AC  -  LcCc)T  +  —?WXCBCB1C  XCW  +  GcGTe  +  LCLTC  =  0.  (6.46) 


Q 


Pre-  and  post-multiply  (6.46)  by  aW-1  to  obtain 

(oc2W~l)(Ac  -  LcCc)  +  (Ac  -  LcCc)(cc2W~')  +  XcBcBjXc 


1 


+^j(aV-')(G.Gf  +  IJZKcfW-')  =  0. 


T\/ ' 


(6.47) 


a1 


With  controllers  (6.45),  the  closed-loop  system  is  described  by  the  matrices 


_  (  A-BBtZ  —BBJZc  \  _(  G  0  \  _  /  H  0  \ 

te  ~  \  q~2GcGtZ  Ac  -  LcCc  )'  e~{-Gc  Le  -BTZ  -B?ZC  )  ’ 


(6.48) 

where  (6.48)  differs  from  (4.36)  only  in  that  X  has  been  replaced  everywhere  by  Z.  Define 

Xe  =  (  0  a2W-1  )  “  °» 


and  consider  the  quantity 


X.F,  +  FjX,  +  —X'G.GlX,  +  HjH,. 
a t 


(6.49) 


The  two  off-diagonal  blocks  of  (6.49)  are  identically  zero.  The  upper-left  block  of  (6.49)  gives 
Ni  defined  in  (6.30).  The  lower-right  block  is  zero  by  (6.47).  Therefore, 

+  FjX.  +  ±X,G.HIX.  +  HjH.  =  (  JJ  )  <  0. 

By  Lemma  4.2,  ( Fe ,  He)  is  a  detectable  pair;  therefore,  by  Lemma  4.1,  the  closed-loop  system 
is  stable,  and  the  closed-loop  transfer-function  matrix  T(s)  =  He(sl  —  Fe)~lGe  satisfies 

imu  <  a.  □ 

Similar  to  Theorem  6.4  in  the  centralized  case,  Theorem  6.5  gives  a  family  of  decen¬ 
tralized  control  laws  which  guarantee  a  predetermined  i/oo-norm  bound  for  the  closed-loop 
system,  and  which  are  characterized  by  controllers  of  the  same  order  as  the  plant.  Unlike 
the  centralized  case,  the  family  of  decentralized  controls  consists  of  only  a  single  controller 
associated  with  each  member  of  a  family  of  state-feedback  controls. 
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6.2.6  Conclusions 


A  convexity  property  of  a  certain  matrix  Riccati  function  is  used  to  characterize  families 
of  controllers  which  provide  stability  and  Hoo  disturbance  attenuation.  This  characterization 
has  two  significant  advantages  over  those  given  [67],  [48],  and  [47]:  First,  it  includes  families 
of  decentralized  control  laws.  Second,  it  excludes  controllers  of  high  order.  It  is  possible 
that  some  controllers  in  the  families  developed  here  could  have  realizations  of  lower  order 
than  that  of  the  corresponding  baseline  controller;  hence,  a  criterion  for  choosing  among  the 
controllers  could  be  the  order  of  their  minimal  realizations.  How  to  choose  from  the  family 
a  controller  with  a  lower-oider  minimal  realization  is  a  problem  for  future  research. 

6.3  H-Infinity  Control  in  Discrete  Time 

In  this  section  we  develop  state-feedback  control  laws  that  provide  disturbance  attenua¬ 
tion  with  a  uniform  //oo-norm  bound  for  discrete  systems  using  state-feedback  and  output- 
feedback  controls  and  also  discuss  methods  of  computing  Hoo  norms  of  discrete-time  systems. 
For  completeness,  we  include  known  results  regarding  i/oo-norm  bounds  of  discrete-time  sys¬ 
tems  and  results  on  characterizing  state-feedback  control  laws  that  guarantee  certain  Hoo 
norm  bounds. 

6.3.1  Preliminary  results 
We  consider  the  system 

Xk+i  =  Axk  +  Buk  +  Gwk  (6.50a) 

(6.506) 

where  u  is  the  control  input,  £  is  the  regulated  output  and  w  is  a  square-summable  dis¬ 
turbance  input.  We  also  make  the  assumption  that  A  is  invertible,  and  that  the  triple 
[A,  B,  H]  is  stabilizable  and  detectable.  Our  development  will  make  constant  reference  to 
the  discrete-time  algebraic  Riccati  equation  (DARE)  of  the  general  form 

P  =  Rx  +  AT  P(I  +  R2P)~xA  (6.51) 
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where,  in  general,  Rt  and  R2  are  symmetric  but  not  necessarily  sign-definite,  as  opposed  to 
LQ  control  with  Ri  <0  and  R2  >  0.  We  associate  with  this  equation,  the  symplectic  matrix 

c  A  +  R2A-TRl  -R2A~t  ' 

* =  -A~TRl  a~t  ■ 

The  following  Lemma  relates  the  stabilizing  solution  of  (6.51)  with  the  eigenvalues  of  $  [69]. 

Lemma  6.4.  If  $  has  no  eigenvalues  on  the  unit  circle  and  [ A ,  /?2]  is  stabilizable,  then 
equation  (6.51)  has  a  unique  stabilizing  solution  P  (i.e.,  such  that  the  spectrum  of  A  — 
R2A~t(P  —  R\)  lies  in  the  open  unit  disk.)  □ 

The  results  developed  here  are  directly  related  to  that  of  finding  a  controller  that  achieves 
desired  disturbance  attenuation  for  the  discrete  system  (6.50).  This  problem  can  be  posed 
as  one  of  choosing  a  control  strategy  that  minimizes  cost  functional 

J(u)  =  sup||^:u>€4,t"#o|.  (6.52) 

Alternatively,  we  may  define  the  cost  functional 

v-wcwi-smi 

Then  V  <  0  for  all  w  €  /2,  if  and  only  if  HT^)]^  <  7,  where  T(z)  the  transfer  function  from 
w  to  £.  In  this  case,  we  say  that  the  system  has  a  disturbance  attenuation  of  7.  It  has  been 
shown  in  [40]  that  the  minimizing  control  is  a  linear  function  of  the  state.  We  may  therefore 
restrict  consideration  to  linear  closed-loop  systems.  The  functional  (6.52)  is  then  equivalent 
to  the  Hoo  norm  of  the  system,  and  we  may,  therefore,  formulate  the  optimal  disturbance 
rejection  problem  as  follows:  Determine  the  stabilizing  state-feedback  control  u  =  Km-,nx 
such  that  for  all  stabilizing  K 

Halloo  <  IITcIloo 

where 

rmin(*)=  J*  (zI-A-BK^-'G,  Te(z)  =  *1  (zI-A-BI<)-lG. 

■Amin  A 
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Note  that  the  H <*,  norm  is  considered  here  to  be  the  “sup  norm”  of  essentially  bounded 
functions  on  the  unit  circle  with  analytic  extension  to  the  region  outside  the  unit  disk. 
The  next  result  identifies  conditions  under  which  this  may  be  accomplished  using  state 
feedback  [40]. 

Theorem  6.6.  Suppose  that  the  triple  [A,  B,H]  is  stabilizable  and  detectable,  and  that 
there  exists  a  stabilizing  solution  P  of 

1  -1 

P=HtH  +  AtP  I  +  (BBt  -  —  GGt)P  a  (6.53) 

with  7  >  0  and  the  side  condition 

72/  -  GtPG  >  0.  (6.54) 

Then  the  control  u  —  Kx,  with 

1  l'1 

K  =  -BtP  I  +  {BBt  -^GGt)P  A  (6.55) 

guarantees  that 

a ) the  matrix  (A  +  BK )  is  stable, 

b) the  matrix  [A  +  ( BBT  -  GGT)A~T{P  -  HTH)\  is  stable,  and 

c)  IITclU  <  7,  where  Tc(z )  =  ^  (zl  -  A-  BK)~XG. 

□ 

A  related  result  is  found  in  [70].  In  the  setting  of  “perfect  information,”  used  in  [70], 
however,  the  control  was  allowed  to  depend  on  both  the  state  and  the  disturbance.  The 
disturbance,  however,  is  generally  not  known. 

The  results  of  [40]  show  that  the  optimal  solution  to  the  disturbance-attenuation  problem 
exists  as  a  state-feedback  control.  That  is,  consider  a  decreasing  sequence  {7<,t  €  N]  such 
that  for  each  7,,  conditions  (6.53)  and  (6.54)  hold.  This  sequence,  being  bounded  away  from 
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zero,  will  have  a  limit,  which  we  call  7,„in.  The  controller  gain  K  given  in  (6.55)  also  has  a 
limit  [40],  A'min,  and  we  have 

7min  =  ||Tnun||oo,  (6.56) 

where 

T^)  =  J1  (zI-A-BK^-'G.  (6.57) 

**min 

In  the  sequel,  will  denote  the  minimal  achievable  Ha o-norm  bound  using  state  feedback. 

The  following  Lemma,  which  is  very  similar  to  the  previous  result,  is  useful  in  designing 
suboptimal  i/oo-norm-bounding  controllers. 

Lemma  6.5.  Suppose  [ E ,  H]  is  detectable  and  for  some  7  >  0,  6  >  0,  and  P  >  0  we  have 

P  >  1 HtH  +  EtP  (j I  -  ^ GGtP)J  E  (6.58) 

7 2I  -  GtPG  >  0.  (6.59) 

Then  for  T{z)  =  H{zl  -  E)~XG 
a )E  is  stable,  and 

Proof.  For  completeness  we  prove  this  result;  it  follows  in  spirit  the  continuous  case  and  the 
case  where  (6.58)  is  an  equality. 

a)  Condition  (6.58)  implies  that  there  exists  N  <  0  such  that 

N  =  ±;HtH+EtPE-P  +  MtS-1M  (6.60) 

cr 

where  M  =  GT PE ,  and  S  =  7 2I  —  GT PG.  Using  condition  (6.59),  the  fact  that  P  >  0, 
and  the  detectability  of  ( E ,  H ),  we  verify  the  stability  of  E  by  standard  results  on  the 
discrete  Lyapunov  equation. 

b)  Let 

=  Exk  +  Gwk,  xQ  =  0,  w  G  /2 
=  Hxk. 


xk+ 1 

C* 
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(6.61) 


Define 


(6.62) 


v,  =  JjIKIIi  -  7Jlklll- 

We  are  done  if  we  can  show  that  Vs  <  0  for  all  w  6  h,  since  this  will  imply  that 

IlClli  -  <  IHI?  <  0  (6.63) 

for  all  w  €  h,  thus  giving  the  attenuation  bound.  Since  E  is  stable,  and  xa  =  0 

x*Px0  =  ~'52{xl+lPxk+ 1  -  xlPxk)  =  0;  (6.64) 

k=Q 

thus,  using  (6.64) 

V5  =  Vs-xToPx0 

=  SicJCi  -  l2wlwk  +  xl+lPxk+ !  -  XTkPxk 

k=0° 

=  5^-^(/fifc)T(/fx*)  -  i2wlwk  +  ( Exk  +  Gwk)TP(Exk  +  Gwk)  -  xlPxk 

k=0° 

=  {^HtH  +  EtPE  -p\xk-  wltfl  -  GTPG}wk  +  2 wTkGTPExk 

fc=o  *•  ®  -1 

=  ^2x^{N  —  MTS~1M}xk  —  wk{S}wk  +  2wkMxk 

JfcasO 

by  (6.58).  Let  w*k  =  5_1Mxjfe,  introduce  wk  =  wk  —  wk  and  note  that 

wkSwk  =  [if;*  —  u;J]T5[it;fc  —  tujj]  +  2  wkSwk  —  wlTSwk 
=  wkTSwk  +  2wkSwk  —  wkTSwk. 

Then  becomes 

V$  =  y ^x*Nxk  —  {u>2T5w£  4-  2 wlSwj  —  WtT5u;£)  +  xjMwj  4-  2 xlMTwk 

k=0 

oo 

=  ■ ATifc  -  u£T5ti£  +  2wl(Mxk  -  Swmk)  -  wf(Mxk  -  Sw*k ) 

*=0 

oo 

=  ^TxlNxk  —  xvlT Swl  <  0 

k=0 
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□ 


for  all  w  €  l?,  since  tu*  =  S~xMxk ,  N  <  0  and  5  >  0. 

Thus,  if  we  can  find  any  P  >  0  that  satisfies  the  conditions  of  Lemma  6.5,  then  the 
stability  of  the  system  is  guaranteed,  and  the  uniform  tfoo-norm  bound  holds.  If  instead  of 
the  inequality  we  have  equality,  then  for  6  =  1  we  have  the  discrete  equivalent  of  [71]: 

Corollary  6.1.  Suppose  [E,  H\  is  detectable  and  for  some  P  >  0  and  7  >  0  we  have 


P  =  HtH  +  EtP  ^1  -  ^GGTP)j  E 


U) 


7 2i-  gtpg  >  0. 


Then  for  T{z )  =  H{zl  -  E)~'G 


a)  E  is  stable ,  and 

Mmu  <  7. 


□ 

Remark  6.1.  If  P  >  0  then  we  can  remove  the  detectability  condition. 

Corollary  6.1  provides  an  iterative  means  of  computing  a  tight  upper  bound  on  the  Hoo 
norm,  with  each  successive  iteration  providing  a  better  estimate  of  the  actual  value.  To 
determine  the  Hoo  norm,  we  choose  7  >  0,  and  then  test  to  see  if  the  conditions  of  Corollary 
6.1  are  met.  This  procedure  is  then  repeated  with  a  lower  value  of  7  to  find  a  new  upper 
bound.  Determining  the  actual  Hoo  norm  involves  a  search  for  7,,  where 

7,  =-  inf  1 7  >  0  :  3p  >  0  such  that  P  =  HTH  +  ETP  — 
and72/  -  GtPG  >  o} 

so  that 

imioo  =  ||//(z/-f:)-1G||oo  =  7.. 


^GGTp'j  E>  0 
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This  is  fully  analogous  to  the  algorithms  proposed  for  the  continuous  case  [71].  A  more  effi¬ 
cient  algorithm  for  computing  the  H <*,  norm  in  the  discrete  case  is  described  in  Section  6.3.4. 
We  also  note  for  future  reference  the  following  two  well  known  facts. 

Lemma  6.6.  If  E  is  stable  and  P  =  ET PE  +  S,  for  some  S  >  0,  then  P  >  0. 

Proof.  Since  E  is  stable  then  we  can  write  P  =  T,'jl0(ET)kSEk  >0.  □ 

Lemma  6.7.  If  ( A,H )  is  detectable,  then  for  any  gain  K,  ( E,H )  is  detectable,  where 

E  ~  A  +  BI<,  and  H  =  [HT  I<T]T. 

Proof.  Let  A  be  an  eigenvalue  of  E  corresponding  to  an  unobservable  mode  of  {E,H)\  that 
is,  there  exists  a  vector  v  ^  0  such  that 

Ev  =  Au  (6.65a) 

and 

Hv  =  0.  (6.656) 

The  proof  consists  in  showing  that  |A|  <  1.  Equation  (6.65b)  implies  that  Hv  =  0,  and 
Kv  =  0,  which  in  turn  implies  that  Ev  =  {A  -f  BK) v  —  Av  —  Au,  and  thus  corresponds  to 
an  unobservable  mode  of  (A,  H).  Since  (A,  H )  is  detectable,  |A|  <  1.  □ 

Thus,  detectability  is  not  lost  under  the  proposed  state-feedback  structure  and  augmented 
output  matrix. 

6.3.2  Properties  of  Riccati  operators 

We  now  introduce  a  discrete- time  Riccati  operator,  analogous  to  that  for  the  continuous 
problem  introduced  in  [10],  establish  its  convexity  properties,  and  proceed  to  find  a  set  of 
state-feedback  laws  that  guarantee  H^-noim  bounds.  The  general  approach  is  based  on  the 
discrete  Algebraic  Riccati  inequality  (DARI)  of  Lemma  6.5. 

For  a  fixed,  positive  scalar  7,  and  matrices  E,  G,  H,  and  H,  we  introduce  over  the  field 
S  —  (X  6  JRnxn  :  X  =  XT}  the  two  domains 

Si  =  {X  6  S  :  (7 2 1  -  GtXG)~1  exists}  (6.66) 


153 


Sp  =  {X  €  S  :  (7 2 1  -  GtXG)  >  0}, 
and  define  the  operators  DR  :  5/  —*  S,  and  R  :  5/  — *  S  where 


DR(X)  =  HtH-X  +  EtX 


I  -  \ggtx 

I 


-1 


E 


1 


i  -1 


=  HtH-X  +  Et  I--rXGGT 

I 


XE 


and 


R(X)  =  HtH  -X  +  AtX  [/  +  BBt  -  ^GG7^  X  A. 
Note  that  when  U  =  \gGt ,  E  =  F„  and  H  =  [HTKj],  where 


/  +  (bbt-±ggt^x,  A , 


X,  =  -flrXa 

L 

F.  =  A  +  BK„ 

and  X,  is  the  stabilizing  solution  of  R{X)  =  0,  then 


DR{X)  =  HtH  +  KjK,  +  FjX{I  -  UX)~lF -  X 
R{X)  =  HtH  +  KJKx  +  FjX{I  -  UX)~xFx  -  X 


where 


Kx  =  -BTX 


(bbt  -  X 


/  + 

Fx  =  A  +  BKX 


-1 


(6.67) 


(6.68) 


(6.69) 


(6.70) 

(6.71) 

(6.72) 

(6.73) 

(6.74) 

(6.75) 


Note  also  that  if  R(X)  =  0  then  X  solves  equation  (6.53),  and  similarly,  for  this  choice  of  E 
and  H,  DR(Xt)  =  R{X3). 

We  first  explore  general  properties  of  the  two  Riccati  operators  and  then  proceed  to  define 
and  demostrate  a  convexity  property  of  the  Riccati  operator  DR(X).  The  first  property 
relates  to  the  monotonicity  of  the  stabilizing  solution  of  the  Riccati  equation  R{P)  =  0  with 
respect  to  7.  The  next  three  properties  relate  to  the  solutions  of  DR(M)  =  0. 

As  usual,  given  ^(7)  €  Rn*m,  the  matrix  -r—  is  defined  if  all  the  partials  exist. 

07 
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Theorem  6.7.  If  7  >  7^  and  P  is  the  stabilizing  solution  of 

-7ggT)p] 

then  exists  and  is  a  negative  semidefinite  matrix. 
d"i 

Proof.  Let  71  =  7  + 1  for  t  >  0,  where  without  loss  of  generality  we  can  let  t  be  small  enough 
that  72  =  7  —  e  >  7min.  Let  ax  —  1  / 7^  and  a2  =  l/ll-  an(^  ^et  A  an<^  ^2  be  the  stabilizing 
solutions  of 

Ft  =  HTH  +  ATPt[I  +  (BBT -atGGT)Pt]-lA 
P2  =  HTH  +  ATP2[I  +  (BBT-a2GGT)P2]~1A. 

Then 

AP  =  Pi  -  P2 


P  =  HtH  +  AtP 


/+(j 


=  AT{Pt[I  +  (BBT  -  atGGT)Pi}-1  -  [I  +  P2(BBt  -  a2GGT)]~l  P2}  A 
=  AT[I  +  P2(BBt  -  a2GGT)]~1{[I  +  P2(BBt  -  a2GGT)]P1  -  P2[I  +  (BBT  -  q1GGt)P1]} 
x[I  +  (BBT  -atGGT)Pi\-1  A 


=  E2&PE\  +  AaD^Dt 

where  Aa  =  a!  -  a2,  P,  =  [I  +  (BBT  -  ajGGT)Pi]~M,  Di  =  GTEi ,  for  i  =  1,2.  Thus 

£-*(£)*+**• 

Taking  the  limit  as  c  ->  0,  we  have  Pi  -*  P,  P2  -»  P,  Pj  E,  E2  -+  E,  Dt  -*  D  and 
Z?2  — »  P;  therefore, 

I  =  £T©£+^- 


0 1 

But  by  Theorem  6.6,  E  is  stable  and  so  by  Lemma  6.6,  -r—  >  0  and  thus 

doc 


_  dP  da  dP  f  2  \ 
da  d 7  3a  \  7 3 )  ~  ’ 


Remark  6.2:  Theorem  6.7  tells  us  that  if  71  >  72  >  7min,  then  P(7x)  <  P(72)  <  P(7min). 
This  result  could  be  strengthened  to  strict  monotonicity  if  controllability  conditions  are 
imposed. 
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Remark  6.3:  If  P  is  chosen  as  the  anti-stabilizing  solution,  i.e.,  E~x  is  stable,  then  P(~i)  is 
monotonically  increasing,  i.e.,  for  7i  >  72  >  7mim  then  P( 71)  >  ^(72)  >  P{lmin)- 

Lemma  6.8.  If  E  is  a  stability  matrix,  M  €  Sp  and  DR(M)  =  0,  then  M  >  0. 

Proof.  Suppose  DR(M)  =  0  i.e., 

DR(M)  =  HtH  -M  +  Et  ME  +  ETMG{~f2l  -  GTMG)~XGT  ME  =  0; 


thus, 

EtME  -  M  =  -HtH  -  ETMGtfI  -  GtMG)~1GtME  <  0. 

Since  E  is  a  stability  matrix,  then  by  Lemma  6.6,  M  >  0.  □ 

Theorem  6.8.  Suppose  M,  and  Ma  are  the  “ stabilizing r  and  “anti-stabilizing”  solutions  of 
DR(M)  =  0.  If  M  is  any  other  matrix  with  DR(M)  =  0,  then 


MS<M<  Ma. 


Proof  M3  is  the  stabilizing  solution  if  Fot  = 
this  condition,  we  have 


E  has  p(F03)  <  1.  Under 


EtM3  -  -LGGTMFj  E  =  Fj„  (/  -  ^M3GGT^j  M3F03. 

Introduce  again  U  =  -^-GGr;  then 

72 

DR(M3)  =  0  =  HtH  +  Fj3M3F03  -  M,  -  Ft03M3UM3F03.  (6.76) 


Note  also  that  the  expression  below  can  be  manipulated  as  follows: 

ErM{I  -  UM)~lE  -  FjtMFot 

=  ET  {(M(I  -  UM)~l  -  (I-  M,U)~lM{I  -  UM3)~X}E 

=  ET(I  -  M,U)~X{{I  -  MSU)M{I  -  UM)~X{I  -  UM3 )  -  M}(7  -  UMa)~xE 

=  ET{I  -  M,U)~X  {(M  -  MtUM,  +  {M-  M,)G(72/  -  GTMG)~X 
GT(M  -  M3)  -  M)}  (/  -  UMt)~lE 
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and  so 


EtM(I  -  UM)-'E  -  FjaMFoa 

=  Fja  {(M  -  Ma)G(~f2I  -  GTMG)-1GT(M  -  M.)  -  M.UM.s}  Foa. 
Thus,  since  M  is  a  solution,  we  have  in  analogy  with  (6.76),  and  using  (6.77) 
DR(M)  =  0  =  HTH  +  ETM(I  -  UM)~XE  -  M 

=  HtH  +  FjaMFoa  -  M  +  ETM(I  -  UM)~lE  -  FjaMFoa 

=  HTH  +  FjaMFoa  -M-  FjaMaUMaFoa 

+Fja(M  -  Mj)G(72/  -  GTMG)-XGT(M  -  Ma)Foa 

=  DR(Ma)  +  Fja(M  -  Ma)Fot  +  M,  -  M 

+Fja(M  -  Ma)G(y2I  -  GTMG)~lGT(M  -  Ma)Foa , 

and  so 

0  =  DR(M)  -  DR(Ma) 


(6.77) 


=  Fja(M  -  Ma)Foa  -  (M  -  Ma) 

+ Fja(M  -  Ma)G(72/  -  GTMG)~1GT(M  -  Ma)Foa. 

Since  Foa  is  stable,  and  Fja(M  -  Ma)Foa  -  (M  —  Ma)  <  0,  Lemma  6.6  gives  M  -  Ma  >  0  or 

Ma  <  M.  Similarly,  for  the  upper  bound,  we  can  write,  (with  p{F^)  <  1) 


DR(Ma)  =  HT  H  +  FjaMaFoa  —  Ma  —  FjaMaUMaFoa 

DR(M)  =  HTH  +  FjaMFoa  -  M  -  FjaMaUMaFoa 

+Fja{Ma  -  M)G(72/  -  GTMG)~1GT(Ma  -  M)Foa. 

and  so 


0  =  DR{M)  -  DR{Ma) 

=  (Ma  -  M)  -  Fja(Ma  -  M)Foa  +  Fja(Ma  -  M)G(12I  -  GTMG)~'GT(Ma  -  M)Foa. 
Premultiplying  by  F~aT ,  postmultiplying  by  F~x  and  rearranging  gives 

F~T(Ma  -  M)F~ 1  -  (Ma  -  M)  =  ~(Ma  -  M)G(12I  -  GTMG)~xGT(Ma  -  M)  <  0. 

Since  F~J  is  stable,  then  Ma  >  M.  □ 
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Theorem  6.9.  If  M  €  S/,  ( E,H )  is  detectable,  and  DR{M)  =  0,  then  M  e  Sp  (i.e., 
72/  -GtMG  >  0J. 

Proof.  Suppose  M  >  HTH ,  and  let  W  =  £-T{A/  -  HTH}E~l  >  0.  Thus 

DR(M)  =  0  =  -EtWE  +  ET M [I  -  UM\-XE 
which  implies  that  M[I  —  U A/]-1  >  0.  But 

A/[/  -  C/A/]-1  =  [I  -  MU]~lM1/2{{I  -  Ml/2UMl,2)M1/2[I  -  C/A/]-1 

which  is  positive  semidefinite  if 

7 2{I  -  Ml/2UM1/2)  >  0. 


This  is  equivalent  to 


72/  -  GtMG  >  0. 


But  since  M  €  Si,  then  (72/  -  GTMG)  has  no  zero  eigenvalues,  and  so  7 2 1  -  GT MG  >  0. 
We  now  show  that  M  >  HTH.  Since  (E,  H)  is  a  detectable  pair,  then  there  exists  M  >  0 
such  that 

M  =  HtH  +  EtME 


which  implies  that  M  >  HT H.  Note  also  that  as  7  — ►  00  in  DR(M )  =  0,  that  A/( 7)  — +  M. 
Recall  also  that  7,  is  the  infimal  number  such  that  for  all  7  €  (700?°°)  there  exist  real 
solutions  of  DR(M)  =  0.  By  Theorem  6.7,  A/,(7)  is  monok  lically  decreasing  for  7  € 
(7,,  00),  and  so 

A/, (7)  >  A/,(oo)  =  M  >  HtH  >  0. 

By  Theorem  6.8,  we  verify  that  >  A/( 7)  >  Af,(7)  >  HTH.  □ 

Definition  6.1.  A  set  A  is  called  convex  if  and  only  if  xu  x2  €  A,  and  a  €  [0,1],  implies 
that  qxj  +  (1  —  a)i2  €  A. 


Note  that  Si  is  not  a  convex  set,  but  Sp  is  convex. 
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Definition  6.2.  Suppose  f  :  ]Rn*n  — ►  iR"Xn,  f(x)  =  f{x)T,  for  all  x  on  A,  which  is  a 
convex  set,  then  f  is  convex  on  A  if  and  only  if  for  all  Xi,  x2  €  A,  and  a  6  [0, 1], 

f(ax ,  +  (1  -  a)x2)  <  af(xi)  +  (1  -  a)/(x2)  (6.78) 

where  “<”  is  defined  in  the  sign-definite  sense. 


Theorem  6.10.  DR  is  convex  on  Sp. 

The  proof  of  this  property  will  require  a  few  preliminary  results  on  DR  and  its  Frechet 
differential  [72].  The  first.  Frechet  differential  6DR(x;  A)  exists  on  5/  and  is  given  in  the 
following  Lemma. 

Lemma  6.9.  6DR(x;  A)  =  —A  +  ET[I  —  x£/]-1A[7  —  Ux]~lE  on  St,  where  U  =  -^GGT . 

Proof.  We  must  show  that  for  x  an  interior  point  of  Si,  and  for  A  such  that  x  +  A  belongs 
to  a  neighborhood  of  x  in  Si,  that 


lim  \\DR(x  +  A)  —  DR(x)  —  6DR(x\  A)||  =  Q 
lAH-o  II A  || 


We  may,  without  loss  of  generality,  restrict  A  such  that  for  some  0  <  M\  <  oo 

||[7  —  (x  4-  A)£/]-1||  <  Mi\\[I  —  xf/]~ 1 1| . 


(6.79) 


(6.80) 


Let  A72  =  ||£^||2||[7  —  f7x]_1||3||t/||.  We  now  have 
DR{x  +  A)  -  BR{x)  -  6DR{x ;  A) 

=  ET  {(x  +  A)[7  -  U{x  +  A)]"1  -  [7  -  xU)-'x }  E  -  ET[I  -  xU]~x/\[I  -  Ux}~lE 

=  ET[I  -  xU}-1  {(7  -  xU)(x  +  A)  -  x(7  -  U{x  +  A))}  [7  -  U(x  +  A)}~lE 
—ET[ll  -  xU)-xA[I  -  Ux]~xE 

=  ET[I  -  xU}-1  A  {[7  -  U(x  +  A)]'1  -  [7  -  Ux]~x}E 

=  ET[I  -  xU]~xA[I  -  U(x  +  A)]-1{/A[7  -  Ux]~xE. 

Thus 

\\DR{z  +  A)-DR{x)-6DR{x-A)\\  <  A/, ||7E7||2 1| [7  -  t/x]"1  ||3||t/[||| A||2 

=  M1M2||A||2 
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and  so  we  readily  see  that 


\\DR(x  +  A)-DR{x)-6DR{x]A)\\ 
IlilPo  ||A|| 


<  lim  M,M2||A||  =  0. 

-||A|HO 


(6.81) 

□ 


Remark  6.4:  Note  that  8DR(x;  A)  is  linear  in  A;  that  is,  for  a  scalar  a,8DR(x;a A)  = 


a8DR(x',  A),  and  also  8DR(x\  Ai  +  dA2)  =  8DR(x]  Aj)  +  8DR(x]  dA2). 


Remark  6.5:  Since  8DR(x\  A)  exists,  it  can  also  be  shown  to  equal 


8DR(x;  A)  =  lim 


DR(x  +  aA)  -  DR(x) 
a 


So,  not  only  does  the  first  Frechet  differential  exist  for  DR  on  Si,  but  actually  the  Taylor 
series  may  be  found.  Remark  6.4  demonstrates  that  the  derivative  can  be  considered  as  a 
linear  operator  on  its  domain  [73].  We  may  thus  write  8DR( i;  A)  as  DRX(  A). 

Although  the  convexity  considered  in  this  section  is  in  the  sign-definite  sense,  rather 
than  element-wise,  the  following  result  is  established  in  the  same  way  as  for  scalar  convex 
functions  of  a  vector  variable.  The  proof  given  here  is  a  generalization  of  that  given  in  [74] 
and  relates  convexity  with  the  first  Frechet  differential. 

Lemma  6.10.  DR  is  convex  on  Sp  iff  for  all  X,  Y  €•  Sp 


DR(Y)  -  DR(X)  >  DRX(Y  -  X). 


(6.82) 


Proof.  Suppose  DR  is  convex  on  Sp.  Then  for  all  a  €  [0, 1]  and  X,  Y  €  Sp 


DR(aY  -  (1  -  a)X))  <  aDR{Y)  +  (1  -  a)DR(X). 


Now  for  a  €  (0, 1],  we  have 

DR{X  +  a(Y  -X)-  DRW  <  DR(Y)  _  DR{X) 
a 

Letting  a  — ►  0  we  obtain  (6.82),  by  Remark  6.5. 
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Now  let  X,  Y  €  Sp ,  and  a  6  [0  1],  and  let  Z  —  f\X  -f  (1  —  a)Y.  Then  Z  6  Sp  and 

DR(X)  >  DR(Z)  +  DRZ(X  -  Z)  (6.83) 

DR(Y)  >  DR(Z)  +  DRZ(Y  -  Z).  (6.84) 

Multiplying  (6.83)  by  a  and  (6.84)  by  (1  -  a)  and  adding  gives 

qDR(X)  +  (1  -  a)DR(Y)  >  DR(Z)  +  aDRz(X  -  Z)  +  (1  -  a)DRz(Y  -  Z ).  (6.85) 

By  the  definition  of  Z  and  Remark  6.4, 

aDRz{X  -  Z)  +  (1  -  a)DRz(Y  -  Z)  =  DRz[a(X  -  Z)\  +  (1  -  a)DRz{Y  -  Z) 

=  DRZ[{  1  -  a)(Z  -  7)]  +  (1  -  a)DRz{Y  -  Z) 

=  -(1  -  a)DRz{Y  -  Z)  +  (1  -  a)DRz(Y  -  Z) 

=  0. 

Substituting  Z  —  aX  4-  (1  —  a)Y  into  (6.85),  then  gives 

aDR(X)  +  (1  -  a)DR(Y)  >  DR(aX  +  (1  -  a)y) 
and  so  DR(X)  is  convex. 

□ 

Proof  of  Theorem  6.10 :  Based  on  Lemma  6.10,  DR  is  convex  on  Sp  if  for  all  x,  y  €  sp, 

DR(Y)  -  DR{X)  >  DRX(Y  -  X) 
so  this  is  what  is  proved.  Let  X,  Y  6  Sp,  then 

DR(Y)  -  DR{X)  =  -(y  -  X)  +  Et{Y{I  -  UY)~X  -  X(I  -  UX)~x}E. 

Now 

(7  -  XU)Y{I  -  UY)~X(I  -  UX)  =  (/  -  XU)Y[I  +  (7  -  UY)~XU{Y  -  X)] 

=  (7  -  XU)Y  +  [I  +  (y  -  X)U(I  -  YU)~l]YU{Y  -  X) 

=  y  -  XUY  +  YU(Y  -X)  +  (Y-  X)U(I  -  YU)~XYU(Y  -  X). 
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Thus 


Y(I  -  UY)-1  -  X(J  -  UX)'1 

=  (/  -  XU)-1  {(I  -  XU)Y(I  -  UY)~l{I  -  UX)  -{I-  XU)X}{I  -  UX)-1 
=  (/  -  XU)~l{(Y  -  X)  +  (Y  -  X)U(Y  -  X) 

+(Y  -  X)U(I  -  YU)~1YU(Y  -  X)}(7  -  UX)-1 


=  (/  -  XU)~x{{Y  -  X)  +  (Y  -  X)U(I  -  YU)~\Y  -  X)}(7  -  UX)-1, 

and  so 

DR(Y)  -  DR(X)  =  -{Y  -  X) 

+Et{I  -  XU)-x{(Y  -X)  +  (Y-  X)U{I  -  YU)~X{Y  -  X)}(I  -  UX)~XE. 

On  the  other  hand 

DRX(Y  -  X)  =  -{Y  -  X)  +  Et(I  -  XU)~\Y  -  X)(7  -  UX)~lE. 

Subtracting  gives 

DR(Y)  -  DR(X)  -  DRX(Y  -  X) 

□ 

=  Et(I  -  XU)~l(Y  -  X)G(727  -  GTrG)-1GT(K  -  X)(I  -  UX )~XE  >  0. 

The  next  Corollary,  states  the  convexity  property  in  terms  of  a  convex  combination  of  ele¬ 
ment?1  ?n  Sp. 


Corollary  0.2.  If  Xi  G  Sp  for  i  =  1, 2, . . . ,  q,  and  /?,  >  0  with  fii  +  . . .  +  /?,  =  1,  then 


DR  (£ftXi)  < 

\i=l  /  |=1 


(6.86) 


We  next  define  the  admissible  set  of  candidate  feedback  solutions.  To  this  end  let 

S7  =  ix  =  £>X,  :  Xi  G  5/,  DR(Xi)  =  0,  Pi  >0,  j^Pi  =  ll  (6.87) 

l  «=i  i=i  J 

where  DR(  )  is  the  operator  (6.68)  with  E  =  F,  —  A  -f  BKt  HT  =  [HT K?\T ,  and  Kt  is 

given  by  (6.55),  and  formed  from  the  stabilizing  solution  of  the  Riccati  equation  (6.53).  Note 

that  based  on  Lemma  6.8  and  Theorems  6.8  to  6.10  it  follows  that  Sp  C  S7.  Note  also  that 

Xt  the  stabilizing  solution  of  DR(X)  =  0,  is  the  “least”  element  of  S7  (i.e.,  X,  <  X  for  all 

X  €  Sy). 
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and  similarly 

KjK,  +  FjX[I-UX)-'Fa  =  AtM(X)-1{BBt  +  N{X,)N(X)-1N(X,}M(X,)-1A.  (6.92) 

So  based  on  (6.91),  (6.92),  with  M(x),  N(x)  defined  by  (6.89),  (6.90)  we  find  that 
T(X,X.)  =  AT{M(X3)-l[BBT  +  N(X3)N(X)~lN{X3)]M{X3)~1  -  M(X)~l)A 

=  AtM(X3)~1{BBt  +  N(X3)N(X)-lN(X3)  -  M{X.)M{X)-'M{X3)}M{X3)-lA 

=  ArM(X3)-'{Q(X,Xt}M(Xt)~1A 

(6.93) 

with 

Q(X,Xt)  =  BBT  +  N(X3)N(X)-lN(X3)  -  M{Xt)M{X)~l  M{ X.) 

=  BBt  +  N(X3)N{X)~lN(X3)  -  [BBT  +  N(X3)][BBt  +  N{X)]-'[BBt  +  N{X.)]. 

(6.94) 
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Note  that  Q(X,  Xt)  is  a  Schur  complement  of  the  block  E22  of  the  matrix  E  defined  as 


_  _  BBT  +  N{X.)N(X)-lN{X.)  BBT  +  N(Xt)  ' 

“  “  BBt  +  N( Xt)  BBt  +  N(X)  ’ 


(6.95) 


Now,  since  (6.95)  can  be  decomposed  as 


E  =  Bb  [Bt  Bt ]  +  AT(X)[AT(X)-1iV(X4)  I]  (6.96) 

it  follows  from  E  >  Q  that  Q(X,X, )  >  0,  which  implies  that  T(X)Xt)  >  0,  and  so  DR(X)  — 
R(X)  >  0  and  thus  0  >  DR(X)  >  R(X).  □ 


6.3.3  Norm-bounding  state-feedback  control  strategies 

In  this  section,  we  discuss  feedback  controls  that  guarantee  upper  and  lower  bounds  on  the 
norm  of  the  system.  The  first  Theorem  presents  the  new  lower  bound  on  the  optimum 
Hoo  norm  achievable  for  a  given  system  using  state-feedback  controls.  For  completeness,  the 
statement  of  the  Theorem  includes  the  known  upper  bound  on  the  H <*,  norm  of  a  system. 

Theorem  6.11.  If  there  exist  P0  >  0  and  a  positive  scalar  7 0  such  that 

-  ^ggt) 

7o  ) 

ill  -  GtP0G  >  0  (6.976) 

then  the  control  u  =  Kx,  with  K  =  -BTP0[I  +  ( BBT  — ~ GGT)P0]~1A  guarantees  that 

\m**(GTP0G)<\\Tc\\l<il  Te(z)  =  Hk  ( zl-A-BK)~xG  (6.97c) 

and  moreover 

X«^{GtP,G)  <  II7UIIL  <  -,1  (6.97 d) 

Proof. 

a)  The  upper  bounds  are  proved  in  Theorem  6.6,  with  the  upper  bound  in  (6.97d)  following 
from  the  one  in  (6.97c)  and  the  fact  that  T„,in(z)  has  a  lower  i/oo-norm  bound  than 
that  given  by  any  other  state-feedback  control. 


P0  =  HtH  +  ATP0 


/+(J 
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b)  To  show  that  the  lower  bounds  hold,  let  E  =  A  +  BK  and  H0  =  ^  with 

K 

K  =  -BtP0[I  +  (BBt  -  4 GGt)P.]-'A.  (6.98) 

lo 

Then  ( E ,  H0 )  is  a  detectable  pair  (Lemma  6.8).  Define 

7.0  =  inf{7  >0:3  such  thatP  =  HjH„  +  ETP(I  -  -ij GGtP)-'E,t‘I  -  GrPG  >  0} 

=  ll/w*/-£)-'c||0O  =  ||7;iu  7 

and  so  the  lower  bound  in  (6.97b)  is  shown  if  we  show  that 

ill  >  GtP{1o)G .  (6.99) 

Note  that  when  P  =  PQ  and  7  =  -y0  then  (6.97a)  can  be  rewritten  as 

I  ~  Z3GGTp°j  E  (6-100) 

and  since  7*/  -  GTP(^0)G  >  0,  we  have  that  7*  >  7min  and  also  that  7o  >  7,0  by  the 
definitions  of  7mm  and  7,0.  Thus,  by  Theorem  6.7,  we  have  P{ 7,0)  >  P(7<>)  and  hence  we 
have  7 II  >  GTP(lao)G  >  GTP{lo)G. 

As  for  the  second  lower  bound,  we  have,  by  Remark  6.2,  that  P{ 7min)  >  P(7o),  and  so 
by  the  definition  of  7inin,  7 U  >  GTP{'ymin)G  >  GtP{j0)G.  □ 

We  are  now  in  a  position  to  form  an  entire  class  of  #00- norm- bounding  state-feedback 
laws,  for  the  system  (6.50). 

Theorem  6.12.  For  7  >  7mjn,  if  X  G  Sy,  then  the  control  law  u*  =  KxXk,  with  Kx  = 

~ BT X  I  +  | BBT  —  — GGrj  X  A  guarantees  that 

a)  A  +  BKX  is  stable,  and 

b)  KJIxlG7 X,G)  <  HTcIloo  <  7  where 

Tc(z)  =  x  ( zf-A  -  BKx)~lG. 


Po  =  HjH0  +  ETP0 
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Proof.  By  Lemma  6.12,  R{X)  <  0,  and  by  Theorem  6.9,  7 2I  —  GTXG  >  0.  With  E  — 
A  +  BI<X  and  H  replaced  with  H  =  [HT  Kj]T  then  by  Lemma  6.7,  (E,  H)  is  detectable  and 
so  Lemma  6.7  gives  the  upper  bound. 

The  proof  of  the  lower  bound  uses  Theorem  6.8  since  X,(~f),  the  stabilizing  solution  of 
R(X)  =  0,  with  7  specified  by  in  Theorem  6.12,  satisfies  X  >  Xt{ 7).  With  E  and  H  so 
fixed,  we  consider  the  Riccati  equation 

P  =  HTH +  ETP[I -UP]~'E  (6.101) 


and  define 

71  =  inf{(7  >  0  :  P  the  stabilizing  solution  of  (6.101)  with  7 2/  —  GT PG  >  0}. 

Since  Pt( 7)  is  monotonically  decreasing  in  7,  then  P*(7i)  >  ^,(7)  and  30  lU  - 
GTPt{~ix)G  >  GTXt(~f)G,  thus  giving 

IIT.1IL  =  il  >  A„„{(GTX.G}.  □ 

6.3.4  Computing  H^- norm  bounds  for  linear  systems 

Various  methods  have  been  proposed  for  finding  either  the  Hco  norm  of  a  system,  or 
bounds  on  its  value.  We  review  available  lower  and  upper  bounds  and  then,  by  appropriate 
modification  of  the  result  in  the  previous  section,  derive  a  new  lower  bound. 

A  straightforward  means  of  computing  a  lower  bound  is  simply  by  choosing  €  [0,2 p], 


i  =  1,2 , . . . ,  jVi,  and  computing 

imu  >  7* 

(6.102) 

where 

TO  =  max  A £{r(e-")T7y*)}. 

(6.103) 

Using  this  method,  we  would  expect  to  obtain  a  better  approximation  of  the  actual  value 
as  we  increase  N\.  Essentially,  we  have  a  search,  but  there  is  generally  no  clear  means  of 
obtaining  a  good  estimate  without  computing  a  large  number  of  values. 
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A  simple  lower  bound  on  the  norm  is  the  H2  norm  of  the  system,  since  the  H2  norm 
must  be  less  than  or  equal  to  the  H norm  for  all  inputs.  It  can  thus  be  shown  that 

||T||1  =  trace  ( HLCHT )  =  trace  ( GT L0G )  <  HTIU  (6.104) 

where  Lc  and  L0  are  the  controllability  and  observability  grammians 

Lc  =  ELcEt  +  GGT  (6.105a) 

L0  =  EtL0E  +  HtH.  (6.1056) 

This  lower  bound  requires  the  solution  of  only  one  Lyapunov  equation. 

The  Hankel  (semi-)  norm,  which  has  proven  to  be  useful  in  the  approximation  of  high- 
order  systems  by  low-order  systems,  may  also  be  used.  Given  any  LTI  system  we  can  consider 
the  Hankel  singular  values  cq,  i  =  1, . . .  ,n,  which  may  be  shown  to  be 

or?  =  Xi(L0Le),i  =  1,. . .  ,n.  (6.106) 

It  has  been  shown  [75],  [20],  that 

l|T||„  =  <w(r)  <  Ill’ll,,  <  2 i>,'(T).  (6.107) 

1=1 

This  gives  a  quick  means  of  obtaining  both  upper  and  lower  bounds  on  the  H <»  norm.  The 
computation  of  these  bounds  requires  the  solution  of  two  Lyapunov  equations.  It  can  be 
shown  that  ||T||2  <  ||T||#,  and  so  the  Hankel  singular  values  give  a  tighter  lower  bound  than 
the  H2  norm. 

The  disadvantage  of  the  last  two  bounds  is  that  they  are  not  always  tight.  In  the  discrete 
case  we  can  establish  a  lower  bound  for  HTII^,  and  thus  a  interval  within  which  the  Hqo  norm 
of  the  system  must  lie.  The  following  Lemma  presents  the  new  lower  bound,  together  with 
the  known  upper  bound  on  the  Ha,  norm. 

Lemma  6.13.  Let  E  be  a  stability  matrix,  and  T(z)  =  H(zl  —  E)~lG.  If  there  exists  P  >  0 
and  a  positive  scalar  7  such  that 

P  =  HtH  +  EtP  E  (6.108) 
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and 


72/  -  GtPG  >  0. 


(6.109) 


Then 

A ^(GTPG)  <  ml  <  (6.110) 

Proof.  The  upper  bound  is  proved  in  Theorem  6.6.  To  show  the  lower  bound,  note  that  since 
7.  =  \\H(zI  -  Er'GWo, 

=  inf{7  >0:3 p>  such  that  P  =  HTH  +  ETP  -  ^GGTp'j  E>  0, 72/  -  GTPG  >  0} 
then  by  Theorem  6.7  (which  holds  in  particular  for  B  =  0),  P( 7,)  >  P( 7),  and  thus  we  have 

7 U  >  GtP(7,)G  >  GtP(1o)G.  □ 

We  can  now  give  an  algorithm  for  computing  norm.  This  algorithm  requires  a  given 
upper  bound  7“  and  a  lower  bound  7*.  We  can  set  7*  =  0  with  7“  a  large  number,  or  else 
select  both  bounds  from  (6.107). 

Algorithm: 

(1)  Given  E,  G,  H ,  7',  7“.  Let  7J*  =  7 u,  and  7{  =  7',  7t  =  ^(7'  +  7"). 

(2)  Compute  P,  (eqn.  (6.108)),  the  stabilizing  solution  (if  possible). 

(3)  If  either: 

a)  no  stabilizing  solution  exists  or 

b)  (7 27  —  GTP,G)  is  not  positive  definite 

then  let  7?+1  =  7,-,  and  =  7?;  otherwise  let  7|+1  =  max{Ai£(GTP,G),7i},  and 
7,“+i  =  7 i- 

(4)  Let  7.+1  =  5(7, !+i  +  7,“+i). 

(5)  If  17,4.1  -  7i|  <  c,  a  specified  accuracy  level  then  stop  with  HTH*,  «  7,+1(±c)  otherwise 

increment  i  and  -f0  to  (2).  □ 
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6.3.5  Examples 

In  this  section  we  consider  two  examples.  The  first  is  related  to  the  computation  of  the 
optimal  i/oo-norm-bounding  state-feedback  approach.  The  second  relates  to  the  computation 
of  the  Hoo  norm  of  a  given  system. 

For  the  computation  of  the  optimal  state  feedback  consider  the  scalar  system 


xk+l  =  axk  +  buk  +  Gwk 
Ck  =  hxk 


(6.111) 


and  also  consider  the  DARE 


P  =  h2  + 


1  +  (^-gaha)Pm 


(6.112) 


Various  phenomena  can  be  illustrated  with  this  system  regarding  the  norm  bounds  discussed 
above.  It  is  also  possible  to  understand  when  the  norm  bounds  are  tight.  The  conditions 
necessary  for  obtaining  the  bounds  are: 

i)  P  is  the  stabilizing  solution  of  (6.112),  and 

ii)  72  —  g2P  >  0  (the  “convexity”  condition). 

Under  these  conditions,  there  exists  a  state  feedback  that  guarantees  an  bound 

less  than  7.  This  example  will  demonstrate  that  as  7  is  decreased,  that  either  condition,  (i), 
or  (ii)  might  be  the  first  to  fail,  thus  stopping  the  search  for  the  minimizer. 

Solving  (6.112)  for  72  gives 


(6.113) 


2  2  p(p-h?) 

7  9  b*Pi-(Ph*  +  a*-l)P-W  *6'113) 

Example  1:  Let  a  =  b  =  g  =  h  =  1/2.  Graphs  of  the  relationship  between  P  and  72  are 
shown  in  Figure  6.1.  The  figure  shows  both  solutions  to  the  Riccati  equation  when  they  exist. 
In  this  figure,  we  show  a  trial  value  72 ,  and  the  lower  bound  obtained  from  the  computation 
of  P( 7,),  i.e.,  g3Pl. 

For  this  system,  the  stabilizability  condition  defines  the  minimizer  P^ n  =  1/2,  for  which 
7 2  =  1/5.  This  occurs  at  the  local  minimum  of  equation  (6.113).  For  the  corresponding 
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Figure  6.1:  Unit  circle  eigenvalues  constraining  condition. 

Kmin  =  -1/4,  we  have  E  =  A  +  BK mm  =  3/8,  stable.  The  Hoc  norm  of  the  closed-loop 
system  is 


Kn 


(zl  -  E)~lG 


( h 2  +  KlJg*  1 
(i-\E\y  5 


(6.114) 


Note  also  that  7 2P  =  ( 1/8)2  <  [|rm;„||^,  and  so  the  lower  bound  is  not  tight  for  this  system. 


Example  2:  a  =  1/2,  b  =  g  =  h  —  1.  A  graph  of  y2  versus  P  is  given  in  Figure  6.2.  The 
state  feedback  that  gives  the  minimal  achievable  Hoo  norm  is  Km ^  =  —1/2,  which  gives  the 
H0 o  norm  UTminll^  =  5/4.  Note  that  in  this  example  the  admissible  minimum  ( P  =  2),  of 
equation  (6.70)  is  on  the  boundary  of  the  “convexity”  region.  Thus,  the  limiting  condition 
here  is  the  convexity  condition.  In  this  example,  the  lower  bound  is  seen  to  be  tight,  since 
for  72  =  5/4,  P,  =  5/4  =  ^Pmin,  thus  72 P,  =  HTmin^  =  72.  It  can  also  be  seen  that  at  the 
minimum,  Ac  =  2/5,  I<^ n  =  —1/2,  and  E  =  0. 
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Figure  6.2:  Convexity  constraining  condition. 


Suppose  that  now  we  wish  to  compute  the  Hqo  norm  of  the  stable  system 


using  the  DARE 


Xk+i  =  Exk  +  gwk 
C*  =  H  xk 


P  =  H  H  4- 


(6.115) 


(6.116) 


*  1  2/  2D  ' -  > 

1  -92/tP 

which  can  be  rewritten  explicitly  in  terms  of  P: 

1  ~9  [l- E')P  -  KTH'  (6  U7) 

Example  3:  Figure  6.3  shows  the  graph  of  72  versus  P  for  the  case  of  E  =  3/8,  g  =  1/2, 
H  =  [1/2  -  1/4] r. 

Note  that  the  lower  bound  g2 P  is  not  tight.  Indeed,  it  can  be  shown  that  for  any  7,  the 
difference  between  the  lower  bound  (computed  for  7)  and  the  H norm  satisfies 

IIT’112  r  D  /  — \2 _ 2  Jdl.\  's.  9_P  H\E\  1  1  o \ 


imiL-  L.B.(-f)2  =  12min-g2P(~f)> 


(1  -\E\)2 


(6.118) 
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Figure  6.3:  Computing  the  norm  of  a  stable  system. 

Thus,  we  see  that  for  the  //oo-optimal  state  feedback  control  problem,  the  convexity 
condition  or  the  stabilizability  condition  could  be  active.  In  the  case  of  the  norm  calcu¬ 
lation,  however,  the  limiting  case  is  always  the  stabilizability  condition.  These  conclusions 
carry  over  to  higher-order  systems. 

6.3.0  The  observer-based  tfoo-norm-bounding  control 

In  this  section  we  present  the  solution  of  the  observer- based  /foo-norm-bounding  problem 
when  only  certain  output  measurements  are  available  to  implement  the  control.  The  main 
results  are  stated  in  this  subsection  and  proved  in  subsection  6.3.7.  The  results  we  present 
parallel  those  available  for  the  continuous-time  problem,  but  are  established  using  a  novel 
transformation  of  the  the  discrete  algebraic  Riccati  equation  (DARE). 

Suppose  that  instead  of  having  full  state  feedback,  only  certain  (noisy)  outputs  are  mea- 
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sured.  We  thus  consider  the  system 


Xk+i  =  Axk  +  Buk  +  Gwk 
yk  =  Cxk  +  vk 

<*  =  r 1 


(6.119) 


and  assume  that  vk  €  /2,  and  [A,  C]  is  detectable  in  addition  to  the  assumptions  made  for 
the  system  (6.50).  The  problem  is  set  up  in  a  manner  fully  analogous  to  the  continuous  case. 
Thus,  we  adjoin  to  (6.71),  the  linear  time-invariant  controller 


tk+i  =  A£k  +  Buk  +  Gwk  +  L(yk  —  Cxk) 


uk  =  K(k 


(6.120a) 


(6.1206) 


where  K  is  given  by  (6.55)  for  given  7,  and  where  u  and  w  are  estimates  of  the  optimal  control 
and  “worst  disturbance”  from  the  state-feedback  solution.  The  actual  “worst  disturbance” , 
w  is  a  disturbance  that  achieves  the  maximum  input/output  (I/O)  energy  ratio,  i.e., 


\\Tc(z)w(z)\\h 

w  =  arg  max  — r,  y  ... - - 

weij  tu/o  I |rt;(^r) 1 


(6.121) 


vthere  Tc(z)  =  H0(zl  —  E)~lG,  Ha=  ^  j ,  E  =  A  +  BK.  It  can  be  shown  [40]  that  there 
exist  “stochastic”  disturbances  in  /2,  that  achieves  I/O  energy  ratios  as  high  as  that  of  w, 


which  can  be  shown  to  be  realizable  in  feedback  form, 


1  r>T  1 


wk  =  I<dxk,  Kd  =  —G  P  I  +  BB  - 


p 


(6.122) 


and  where  P  is  the  stabilizing  solution  of  (6.53). 

Using  the  structure  (6.120),  we  seek  the  matrix  L  to  achieve  stability  and  guarantee  a 
4esired  H^- norm  bound.  To  this  end  we  form  the  closed  loop  system: 


with  the  output 


4  BI< 
LC  Ac  —  LC 


H  0 


G  0 
0  L 


w 

.  v  L 


0  I< 


(6.123a) 


(6.1236) 
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where  Ac  —  [I  +  ( BBT  — ~ GGT)F]  ~lA  =  A  -t-  BK  +  GKd.  Let  e  =  x  —  and  introduce 


the  transformation 


x  = 


X 

‘  /  O' 

X 

e 

7  -/ 

and  apply  it  to  (6.123)  to  obtain 
ifc+i  = 


E  -BK 

-GI<d  A  +  GKd  -  LC 


x 

e 


Ik 


G  0 
G  -L 


w 


(6.124) 


=  E0xk  +  G0wk  (6.125) 


ik 


and 


a  = 


'  H  0  1 

X 

K  -K  \ 

e 

=  H0xk. 


(6.126) 


The  central  result  of  this  section  defines  an  observer- based  controller  that  satisfies  an  uniform 
/Zoo-norm  bound,  and  can  be  stated  as  follows: 

Theorem  6.13.  If  there  exists  P  >  0  satisfying 


P  =  HtH  +  AtP 


i+(bbt--LggApY' 


) 


A, 


with  7  >  0  and 


7 2 1  -  GtPG  >  0 

and  if  there  exists  V  >  0  that  satisfies 

1 


V  =  —HJ  H  -  C  C  +  A1  V[I  -  GG1  V]"M, 


with 


1 


/ - zGG  P 

i 


-l 


7 2V  >  HtH  +  AtP 
and"  if  the  gain  matrix  L  is  chosen  to  be 

T‘  =  (7  ~  ^2V~lP)  A  +  CT°  ~  ^2HTH)  Cl 
then  for  Tc(z)  =  H0(zl  —  E0)~lG0  we  have 

a)  E0  is  stable,  and 

b)  li^lU  <  7. 


(6.127) 


(6.128) 


(6.129) 


(6.130) 


(6.131) 
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Thus  the  solution  of  the  problem  is  given  in  terms  of  two  uncoupled  Riccati  equations, 
as  in  the  continuous  case. 

A  related  result  has  been  obtained  by  [70].  However,  their  conclusions  are  again  based  on 
the  “perfect  information”  case.  In  addition,  the  solution  of  that  problem  is  given  in  terms 
of  two  coupled  Riccati  equations. 

The  proof  of  Theorem  6.8  will  be  based  on  the  relationship  between  the  discrete  algebraic 
Riccati  equation  (DARE)  of  dynamic  games,  and  its  relationship  to  a  nonsymmetric,  gener¬ 
alized,  algebraic  Riccati  equation  (GARE),  and  will  be  given  in  the  next  section.  This  novel 
approach  also  gives  insight  into  the  problem,  using  results  in  [76]  regarding  the  solution  of 
generalized  Riccati  equations. 


6.3.7  The  generalized  Riccati  equation 


Recall  the  DARE 


P  =  HtH  +  AtP  |  /  +  ^BBt  -  ^GGr  j  P  A 


(6.132) 


and  the  associated  symplectic  matrix 


A  +  ^BBT  -  ^GGr)  A~tHtH  -  (^BBT  -  -^GG3^  A' 
-A~THTH  A~t 


(6.133) 


We  now  consider  the  GARE 


X  =  (AtX  +  HtH )  A  -  (bBt  -  ^GG3^  X 


(6.134) 


-XA+A't  I  +  HtH  (bBt  -  ^GGr)  A~t  X-X  [bBt  -  ~ GGT )  X-A~THTHA  =  0. 

(6.135) 

This  is  a  continuous- time  ARE,  and  has  as  its  associated  generator  matrix 

A  -(BBT-  ^ GGr>) 

r^/7i\i-  (6-136> 

-A~tHtHA  A~t  I  /  +  HtH  \BBt  -  ± GGt j  A~t 
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0  I 
-I  0 


,  we  have 


It  can  be  shown  [26]  ihat  $  is  a  symplectic  matrix  since  for  U  = 

U~X$TU  =  $-1.  It  can  be  shown  that  /,  on  the  other  hand,  is  neither  symplectic  (since 
U~l£TU  ^  i~X),  nor  Hamiltonian  (since  U~xjFlJ  ^  —f)  [26].  However,  like  $,  the  matrix  / 
has  the  property  that  if  A  is  an  eigenvalue  of  /,  then  1/A  is  also  an  eigenvalue.  Indeed,  we 
have: 

Lemma  6.14.  $  and  /  have  the  same  spectrum. 

Proof.  If  two  matrices  7\  and  T2  are  square,  then  the  spectrum  of  the  product  7\!r2  is  the 
same  as  the  spectrum  of  X27\.  Examining  $  and  /,  we  have 


*  -{bbt-±gg*} 


i  = 


0  I 

I  0 

-a-thth  a-t 


A 

0 


I  0 

-A-THTH  A~t 

(bbt  - 


=  txt2 

=  t2tx. 


Remark  6.6:  We  take  note  from  the  proof  of  Lemma  6.14  that  the  invertibility  of  T\  and 
T2  depend  only  on  the  invertibility  of  A.  Thus,  if  A  is  invertible,  then  neither  $  nor  /  have 
zero  eigenvalues.  Thus  the  “Hosed-loop”  matrix 


Ac-  A  -  [bBt  -  ^ GGT^j  A~T{P  -  HtH), 


(6.137) 


(which  arises  in  Lemma  1.2),  has  no  zero  eigenvalues,  and  is  thus  invertible.  □ 

Suppose  the  matrix  A  contains  a  subspectrum  of  /.  The  next  Lemma  demonstrates  the 
relation  between  the  GARE  and  /,  based  on  [76]. 

/ 


Lemma  6.15.  If/ 
Proof.  If 


I 

X 


A,  then  X  solves  (6.135). 


-A~tHtHA  A~t 


-  (BBT  - 

I  +  HtH  (^BBt  -  -~GGT  j 


I  —T 


I 

X 


I 

X 
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then 


A  -  \  BBt  -  -^GGT^)  X  =  A, 


-A~tHtHA  +  A~t[I  +  HtH  [bBt  -  -1gGt  j  A~T]X  =  X\, 

and  from  (6.138),  (6.139)  follows 

-HtHA  +  [/  +  HTH  [bBt  -  Jj GG A~7]X  =  ATX A, 
A  -  -  -^GG7^  XA 


(6.138) 

(6.139) 


=  ATX 


or 


(ArX  +  HtH)A  -  I  +  (ArX  +  Ttf)  -  -IgG7^ 


X  =  0, 


(6.140) 


which  reduces  to 


(Ar*  +  tf7#) 


-( 


BB7  -  -^GGrj  X 


-X  =  0. 


LJ 

If  p(A  -  {^BBT  — ^GG7^  X)  <  1,  (i.e.,  p(A)  <  1  by  (6.138)),  then  X  is  called  the 


stabilizing  solution  of  (6.135).  Note  that  instead  of  the  vectors 
vectors 


Xx 

X2 


I 

X 

V, 

Yt 


,  we  may  use  the  Schur 


if  A  is  in  Jordan  form, 
so  nctc  that  unlike  the 


if  A  is  in  real  Schur  form,  or  the  eigenvectors 
giving  X  =  XiXi1  (or  X  =  YiYf1)  as  a  solution  of  (6.135).  A 
solution  P ,  of  the  DARE  (6.53),  the  solution  X  of  the  GARE  is  non-symmetric,  while  A7  X, 
however,  is  symmetric.  We  now  demonstrate  the  relationship  between  the  solutions  of  the 
GARE  and  the  DARE. 

Lemma  6.16.  If  X  and  P  are  related  by  A7X  =  P  —  H7 H  and 

,  \  i-i 

I  +  P(  BB7  -  —tGG7 


( 


exists  then  P  solves  (6.53)  iff  X  solves  (6.135).  Moreover,  P  is  the  stabilizing  solution  to 
(6.53)  iff  X  is  the  stabilizing  solution  to  (6.135). 
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Proof.  By  the  Remark  6.5,  we  know  that 
Also,  by  hypothesis,  we  have 

X  =  A~t{P  -  HtH ). 
To  prove  the  first  assertion,  note  that  X  solves  (6.135)  if 


A  -  (bBt  -  ^GGrj  A~T(p  ~  rTh) 


exists. 


(6.141) 


A  -  BB1 


(. AtX  +  HtH) 

By  (6.141)  the  above  expression  is  equivalent  to 
P 

which  is  equivalent  to 


-7“') 


-X  =  0. 


A  -  ^ BBt  -  -^GG7^  A~T(p  ~  hTh )  ~  A~T(p  ~  hTh )  =  0 


(6.142) 


+  P  (bBt  -  ^GGTjj  a~T(p  ~  hTh )  =  PA 


or 


(6.143) 


(6.144) 


A~t(P  -  HtH )  =  +  P  ^BBt  -  i GGt  j  ^  PA. 

On  the  other  hand,  expression  (6.142)  is  equivalent  to 

HtH  -P  +  AtPA  -  AtP  ^BBt  -  ^GG7^  A~t  (P  -  HtH )  =  0. 

In  light  of  (6.143)  and  (6.144),  expression  (6.142)  is  equivalent  to 

0  =  HTH  -P  +  AT PA  -  AtP  [bBt  -  ^GG7^  (i  +  P  (bBt  -  ^GG7^  )  PA 

=  HtH  -  P  +  At  |/  +  P  i^BBT  -  -^GGTj  -  P  (bBt  -  -^GG7^  | 

+  P  [bBt  -  GG7^  j  PA 

=  HTH-P  +  AT(l  +  p(BBT--^GGTyj  PA 

=  HTH  -P  +  atp(^I+  [bBt  -  ^GG7^  pj  Ay 

and  so  P  solves  (6.53)  if  X  solves  (6.135).  For  the  proof  of  the  second  part,  we  have  from  the 
proof  of  Lemma  6.15  that  X  is  the  stabilizing  solution  of  (6.135)  if  A  -  ^  BBT  — ^-GG7^  X 
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is  a  stability  matrix.  But 

Ac  =  A  -  ^ BBt  -  A~T(p  ~  hTh)  =  A  -  -  -^GG7^  X, 

which,  by  (6.137)  is  stable  if  P  is  the  stabilizing  solution  of  (6.53).  □ 

Remark  6.7:  When  P-1  exists  and  P  solves  (6.53),  the  condition  P  >  HT H  is  equivalent 

to  P-1  >  -^?GGt  —  BBt.  In  Corollary  6.1,  we  note  that  the  condition  7 2I  —  GTPG  >  0, 
72 

is  equivalent  to  P~l  >  -^GGr,  when  P-1  exists,  since  P1/2  ^P-1 - ^GG7^  P1/2  >  0  is 

equivalent  to  /  — i-GTP1/,2P^2G  >  0,  and  implies  that  P  >  HTH.  Thus,  in  Corollary  6.1, 
72 

when  P-1  exists,  P  >  HT H  is  equivalent  to  7 27  —  GTPG  >  0. 

Remark  6.8:  Lemma  6.16  was  proved  for  Rt  =  HTH  >  0  and  R2  =  BBT  — \;GGT ,  which 

7 

is  sign-indefii  ite.  The  proof,  however  does  not  depend  on  the  sign  definiteness  of  Rx,  and 
can  be  used  for  indefinite  Rx.  This  fact  will  be  exploited  in  the  observer  equations. 

The  motivation  for  using  the  GARE,  instead  of  the  DARE  in  the  proof  of  Theorem  6.13 
is  that,  by  using  the  GARE,  we  arrive  at  expressions  that,  as  will  be  shown,  are  similar 
to  the  corresponding  continuous-time  expressions,  e.g.,  K  =  —BTX,  Kj,  =  —zGT X  [1], 

r 

[13].  This  similarity  serves  two  purposes:  First,  it  simplifies  the  expressions.  Second,  and 
perhaps  more  important,  it  provides  insight  from  the  results  on  the  observer- based  f/oo-norm- 
bounding  problem  in  the  continuous-time  case,  and  provides  guidelines  for  the  solution  of 
the  discrete-time  problem. 

In  many  optimal  control  problems,  duality  plays  an  important  role.  In  the  search  for  a 
solution  to  the  present  problem,  we  again  seek  to  exploit  duality  as  was  successfully  accom¬ 
plished  in  the  continuous  problem  [1].  Thus,  we  consider  an  observer  DARE, 


Q  =  GGt  +  AQ  I  +  (cTC  -  Q  aT- 


(6.145) 


which  is  the  dual  of  the  control  DARE  (6.132).  We  expect,  by  analogy,  that  the  condition 
72/  —  HQHt  >  0,  will  be  necessary;  it  implies  that  V~x  =  Q  >  GGT.  Note  that  V  satisfies 


V  =  — HTH  -  CrC  +  ATV[I  -  GGtV)~1A, 


(6.146) 
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which  is  the  DARE  found  in  Theorem  6.13.  Along  with  V,  by  fully  analogous  development, 
we  associate  with  the  DARE  (6.146)  the  GARE 

W  =  ^AtW  +  X^HtH  -  CTC^j  ( A  +  GGtW),  (6.147) 

where  W  is  related  to  V  by 

AtW  =  V  -  HtH  +  CTC.  (6.148) 

We  now  return  to  the  proof  of  Theorem  6.13. 

f  p  n 

Proof  of  Theorem  6.13 :  Define  P  =  o  p  ’  w^ere  A  =  72U  ~  P-  Using  Corollary  6.1, 
we  desire  to  show  that  with  L  given  by  (6.131),  P  is  positive  definite  and  satisfies 

P  =  HjH0  +  Ejp(l~±G*G0p'j  Ea  (6.149) 

y2I-GjPGa  >0.  (6.150) 

Hence,  by  Corollary  6.1,  the  closed-loop  system  is  stable  and  its  //<»  norm  is  bounded  by  7. 
Transforming  the  DARE  to  the  associated  GARE,  leads  to  X  satisfying 

X  =  (E?X  +  H?H0)  (eo  +  ^GoG^X^j  .  (6.151) 

We  now  show  that  X  of  the  form 

X-[o  £“]•  <6152> 

where  X  is  the  stabilizing  solution  of  (6.135)  while  X12,  and  X22  satisfy 

EtXu  =  (I<jGTX22  +  I<tK ),  (6.153) 

A22  =  7 2W-Xl2-X,  (6.154) 

solves  the  GARE  (6.151).  We  then  conclude,  by  the  use  of  Lemma  6.16,  that  P  is  related 
to  X  via 

EjX  =  P-HjH0  >  HjH0,  (6.155) 
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also  satisfies  (6.150)  and  th.  s  is  the  desired  solution  to  the  DARE  (6.149). 


IjCL 

g”  £  ]  =  +  fix-)  [E°  ■■  (6.156) 

and  so  (6.151)  is  established  if  Gu  =  G\2  =  G2X  =  G 22  —  0.  Note  first  that  using  (6.153), 
and  the  definitions  of  Kd  and  K ,  that 

riT  v-  .  uT  u  r  ET  -KJGT  1  f  X  Xn]  ,  r  HtH  +  KtK  -KtI< 


EJX  +  HJH0 


-KTBT  ( A  +  GKi  -  LC)T  I  I  0  X 


-KTK  I<TK 


ETX  +  HTH  +  I<TK  ETXU  -  KjGTX22  -  Kr K 

-I<TBTX  -  KTK  ( A  +  GKd  -  LC)TX22  -  KTBTX12  -  I<TK 


We  also  have 

E0A~G0GToX  = 


ATX  +  HTH  0 

0  (A  -  LC)tX22  +  ATXl2 


(6.157) 


E  ~BK  I  ,  i.  f  GGT  GGT  X  m2 

-GKd  A  +  GKd-LC  J  +  72  [  GGT  GGT  +  LLT  J  [  0  X22 


where 


0  Ac  +  N  +  L  I  ^LtX22  -  C 


N  =  -BI<  +  --GGT{Xl2  +  X22). 
V 


(6.158) 


(6.159) 


Thus,  equation  (6.156)  becomes 


Gu  G  i2 
G2 1  G22 


AtX  +  HtH 


X  Xl2 
0  X22 


{A  —  LC)T X22  +  AT X i2  I  0  Ac  +  N  +  L  (  —LTX22  —  C 


(6.160) 


This  gives 


Gu  =  (ATX  +  HTH)AC  -  X  =  (AtX  +  HT H)  A  -  (b BT  -  ~GGT^j  X  -X 


=  0, 
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by  (6.134)  and  Lemma  6.16.  Next,  note  by  inspection  that  G21  =  0.  Introduce  M  = 

BBtX  +  -~GGT X22,  and  observe  that 
1 

G17  =  {ATX  +  HTH)N  -  Xu 


=  (ATX  +  HTH) 


-bk  +  \ggt(xu  +  X22) 

7 


-  e-txtm 


=  ( AtX  +  HTH)  +  ^GGTE-TXrM^J  -  E~TXTM 


=  (AtX  +  HtH)  [X-TET  +  ~iGGTj  E~TXTM  -  E~TXTM 

=  j(ArX  +  HtH)X~t  (et  +  ^XtGGt^  -  /  j  E~TXTM 

=  {PX-T4T  -  I)E-TXTM 
=  {PP'1  -  I}E-TXTM  =  0. 

Before  proceeding  to  establish  that  G22  =  0,  we  first  note  from  (6.153)  and  (6.154).  that 

X22  =  7 2W  -  Xn  -  X  =  72^  -  X  -  E~T(KjGTX22  +  KtK),  (6.161) 


which  implies  that 


(/  +  E-TKjGT)X22  =  l2W  -  X  -  E~tKtK ,  (6.162) 


and  so 

AjX22  =  (ET  +  KJGT)X22  =  ET(I  +  E~TKJGT)X22 

=  Et{~i2W  -  X-  E~tKtI< )  =  7 2ETW  -  atx  +  ktk  -  ktk 
=  72EtA~t{AtW)-AtX 


From  (6.163) 


7  2EtA~t 


^ HtH  +  CTC^j 


-  P  +  HTH. 


\hth  +  CTC 

72 


T 


-  P  + 


(6.163) 
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Now,  using  the  definition  of  Ac  from  (6.137),  and  using  (6.141)  to  relate  X  and  P  produces 
X22  =  P  [p-1  -  ^GGT^j  A~t(j2V  -  HtH  +  7  2CTC)  -  AfATX 
while  from  (6.146)  and  the  facts  that  X  =  PAC  and  that  ATX  is  symmetric  we  have 


X22  =  P 


p- 1  -  \ggt 

i 


i  -i 


(72VT*  -  -tGG1 


A- PA 


(72V)-‘  -  —zGG 


=  p|p-i-lGGT-(72^)-1  +  -iGGr| 
and  using  again  (6.146)  this  finally  produces 

x22  =(l-  “2PK_1)  A~T  b2y  -  nTH  +  ^ GTG )  • 

Therefore  (6.131)  simplifies  to 

Xj2L  =  7  2CT. 


-l 


(6.164) 


(6.165) 

Now  consider  G22.  Since  Gu  =  G\2  =  0,  then  G22  =  G22  +  Gu  +  G i2  and  so  we  proceed  to 
show  that  this  sum  is  equal  to  zero.  We  have 

G22  =  G22  +  Gu  +  G\2 


=  [(>1  —  LC)T  X22  +  /4rXi2] 


Ac  +  N  +  L 


(?*■ 


X22-C 


-X: 


22 


+{ATX  +  HTH)AC  -X  +  ( AtX  +  HtH)N  -  Xn 

1 

Ac  +  N) 


=  {(A~LC)tX22  +  AtX12\ 
+(AtX  +  HtH) 


Ac  +  N  +  L[  —LtX22  -  C 


—  (X  +  X12  +  X22) 


=  [{A  -  LC)tX22  +  ATXl2  4-  AtX  4-  HtH) 


Ac  +  N  +  L 


■(X  4-  Xn  +  X22)  -  {AtX  +  HTH)L  [^LT X22  -  cj 


-  c) 


Ac  +  N  +  L  -LtX22-C 


=  [At(X  +  Xl2  +  X22)  4-  HTH  -  CTLTX 22] 

-(X  +  Xn  4-  X22)  -  (4rX  +  HTH)L  [^LtX22  -  cj 


and  using  (6.154)  and  (6.147),  as  well  as  equations  (6.146),  (6.157)  and  Remark  6.7, 
G22  =  [AT{~i2W)  +  HT  H  —  ~i2CTC  —  Ct(LtX22  —  y2C)] 
x  a  +  ggtw +  l(^ltx22-c^J 

-(7 2W)  -  (ATX  +  HTH)L  (J^LtX22  -  cj 
=  72|  AtW +  ^HtH -CtC  [A  +  GGTW]  -  W  j  =  0 


and  thus,  (6.151)  is  satisfied.  Now  consider  (6.155).  We  have,  from  (6.151) 

FTy,HTH  _  ATX  +  HTH  0 

A  +  M0  tio  -  0  (y4  —  LC)tX22  +  ATXn 


=  [ 


ATX  A  HTH  0 

0  7 2AtW  -  AtX  -  7 2CTC 


’  P  0 

=  o  72  (v  —  ^hth  +  cTcyj  -  pa  hth  - 7 2cTc 


(6.166) 


7 2V  -P  >  HtH  +  AT  P-1  -  ^GGT j  A  -  P 

>  HtH  A  At  . P-x  A  BBT  -  A  -  P  =  0; 


-  P  0  -p 
0  y2V  -  P  \  ~ 

Now  P  is  positive  definite  if  =  72V  —  P  is  positive  definite,  and  this  is  established  using 
(6.127),  and  (6.130): 


(6.167) 


thus,  (6.155)  is  established  by  (6.166)  and  (6.167).  Finally,  consider  (6.150).  We  wish  to 
show  that  conditions  (6.128)  and  (6.130)  imply 

l2 1  -  GqPGo  >  0. 

We  recall  from  Remark  6.7,  that  (6.150)  is  equivalent  to  P  >  Hj H0,  which  we  will  demon¬ 
strate.  Since  P  satisfies  (6.127),  then 

( P  -  HtH)~x  -  A~1BBtA~t  =  A -1  ^ P -1  -  ^GGT^j  A~t, 
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and  so  conditions  (6.128)  and  (6.130)  imply  that 

72!/  >  HtH  +  [(P  -  HTH)~X  -  A-lBBTA~T}-1  >  0 


or 


(6.168) 


(P1+  P  -  HtH)  >  [(P  -  HTH)~X  -  A-1BBtA~t]-1  >  0 
since  72V  =  Pi  +  P.  Since  P  >  HT H,  then  (6.168)  holds  if 

( P  -  HtH)-1  -  A-1BBtA~t  >(Px  +  P-  HtH )~x  >  0, 

which  is  equivalent  to 

(P  -  HtH){(P  -  HTH)~l  -  A-xBBtA-t  -  (Pi  +  P  -  HTH)~1}{P  -  HTH)  >  0.  (6.169) 

Since  K  =  —BtA~t(P  —  HTH),  using  (6.169)  we  can  write 

KTK  =  (P-  HtH)A-'BBtA-t(P-HtH) 

<  (P  -  HTH){{P  -  HTH)~l  -  (Px  +  P  -  HTH)~l }(P  -  HtH) 

=  \{P  -  HT H)~x  +  P{')~x . 


This  leads  to 


/  >  I<[(P  -  HTH)~X  A  P^}KT 

=  K[I~I) 


'  P  -  HTH  0  ' 

-i 

/ 

0  P i 

-I 

KT  =  KP-XKT. 


Thus,  conditions  (6.128)  and  (6.130)  imply  that 


P  -  KTK 

'  P  -  HTH 

0 

I 

0 

Pi  . 

-I 

KTI<[I  -  I]  =  P  -  HJH0. 

Pemark  6.9:  The  structures  of  L  and  K  in  this  problem  (i.e.,  K  =  —BTX  and  = 

7 2C)  are  similar  to  those  of  the  continuous-time  solutions,  though  they  are  not  intuitive  from 
the  DARE  equations.  The  use  of  the  GARE  framework  thus  provides  an  elegant  solution  to 
this  problem.  Numerically,  the  computation  of  the  GARE  itself  should  also  be  more  robust, 
since  no  inversions  are  required. 
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Remark  6.10:  If  the  worst  disturbances  are  assumed,  i.e., 


w  1 
v  =7G»Xi’ 


then  the  total  closed- loop  matrix  becomes 


E0  +  -4 G0Gt0X  =  |  * 


0  A  +  GGTW  ‘ 


(6.170) 


Since  A  +  GGTW  is  the  “closed-loop”  matrix  associated  with  the  observer  Riccati  equation, 
we  see  that  the  eigenvalues  are  the  union  of  the  control  and  observer  closed-loop  matrix 
eigenvalues. 

Thus,  we  have  established  the  observer-based  controller  analogous  to  that  in  the 
continuous-time  case.  The  results  here,  because  of  the  discrete  Riccati  equation  structure, 
have  added  conditions  (6.128)  and  (6.130).  Note  that  (6.130)  is  a  condition  on  the  relation¬ 
ship  between  Riccati  solutions  (6.127)  and  (6.129).  A  similar  condition  is  found  in  [48,1], 
Theorem  3]. 

6.3.8  A  lower  bound  on  the  optimal  H <*,  norm 

As  in  the  case  of  the  state- feedback  control  for  7  >  7min,  it  is  possible  to  obtain  both  an 
upper  and  lower  bound  on  the  minimal  achievable  Hoo  norm  when  observer- based  controls 
are  used.  Let  70  be  the  the  minimal  achievable  norm  using  a  controller  of  the  form 
presented  here,  such  that  for  all  7  >  70,  there  exist  P,  V  and  L  satisfying  (6.127)  -  (6.131). 
The  next  theorem  gives  a  lower  bound  on  the  value  of  7°. 

Theorem  6.14.  If  there  exist  positive-definite  P  and  V  such  that 

P  =  HTH  -I-  AtP  I  -I-  [bBt  -  ~;GGT^  P  A 
j2V  =  HTH  -  j2CTC  +  72AtV[I  -  GGTV)-XA 


with  7  >  0,  7 2 1  -  (PPG  >  0,  and  72V  >  HTH  +  ATP  -  ~GGTpj 

|  HtH  +  AtP  (/  -  ^GGTpSj  A j  V1 1  <  70  <  7. 


A,  then 


(6.171) 
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The  proof  of  the  theorem  requires  two  technical  Lemmas  relating  the  monotonicity  of 
solutions  of  the  DARE  with  respect  to  7. 

Lemma  6.17.  U-r)'1  -  — -GGT|  is  monotonically  increasing  in  7  for  7  €  (70, 0). 


Proof.  By  Theorem  6.7,  P( 7)  is  monotonically  increasing  for  7  €  (7min,  °°)-  It  can  be  easily 
shown  that  70  >  7min,  and  so  P( 7)  is  monotone  in  (70,  00).  Thus,  for  7i  >  72  >  7°  >  7min, 
it  follows  that  P( 71)  <  P(72)  <  P( 7°y,  and  so  P( 71)-1  >  P(72)-1  >  P(7°)-1-  We  also  have 
that  — \?GGT  >  — \gGt  >  — ~GGr,  and  thus  we  have 


PM-'  -  -2GGT  >  PM-'  -  3 GGT  >  PhT'  -  4ggt. 

7i  72  7 


Therefore, 


PM'1  -  ^GGTj  ‘  <  -  iGGT]  '  <  -  ±GGT 

Lemma  6.18.  V(~i)  is  monotonically  increasing  in  7  for  7  €  (70, 00). 


Proo/  Recall  that  if  Q  is  the  stabilizing  solution  of  (6.86a),  by  analogy  with  Theorem  6.7, 
Q  is  monotonically  decreasing  in  7  for  7  €  (Tmin*  °o),  where  is  the  smallest  7  associated 
with  the  (dual)  observer  problem.  It  is  easy  to  show  that  70  >  7mm.  Thus,  Q  is  monotonically 
decreasing  in  (7°,oo),  and  so  V  —  Q-1  is  monotone  increasing  there.  □ 

Proof  of  Theorem  6.14 :  The  upper  bound  follows  from  the  definition  of  70.  To  prove  the 
lower  bound,  we  have  to  show  that  for  e  >  0 

(7°  +  e)2V(7)  >  HtH  +  At  ^P( 7)-1  -  A- 

Without  loss  of  generality,  we  can  choose  e  >  0  such  that  7  —  7°  >  e  >  0.  By  Lemmas  6.17 
and  6.18,  we  have  that 

(70  +  e)2V(j)  >  (70  +  e)2V(7<>  +  e) 

>  HT H  +  At  [P(7»  +  <T'  -  A  D 

>  HT::  +  At  (P(7)-'  -  ^GGT)  A. 
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7  CONCLUSION 


The  research  described  in  this  report  has  provided  many  new  results  and  research  direc¬ 
tions.  These  include  the  FH-norm-optimal  low-order  controller  design  problem  with  con¬ 
trollers  restricted  to  belong  to  the  class  of  projective  controllers,  the  ARE-inequality  based 
approach  to  designing  fZ^-norm  suboptimal  full  order  controllers  and  its  application  to  the 
decentralized  control  problem  using  full  order  controllers,  the  development  of  design  equa¬ 
tions  for  control  systems  reliable  with  respect  to  sensor  and  actuator  outages,  the  design  of 
strongly  stable  systems  and  decentralized  control  systems  reliable  with  respect  to  a  loss  of 
certain  control  channels.  In  addition,  initial  results  were  obtained  in  the  output- feedback- 
based  f/oo-norm-bounding  controls  for  discrete  systems  based  on  the  transformation  of  the 
DARE  to  the  GARE.  These  results  include  both  an  upper  and  a  lower  bound  on  the  value  of 
the  norm.  Parametrizations  of  state-feedback  and  output-feedback  controls  that  provide 
a  specified  bound  on  the  H «,  norm  were  also  obtained. 

The  design  of  low-order  controllers  reduces  ultimately  to  a  nonlinear  optimization  prob¬ 
lem,  or  to  a  problem  of  extracting  elements  of  a  subset  to  obtain  a  suboptimal  solution.  In 
this  respect  we  have  combined  the  projective  controls  approach  with  FH-norm  optimization 
to  simplify  the  computational  aspects.  The  use  of  projective  controls  provides  a  convenient 
way  of  parametrizing  the  entire  class  of  controllers  of  a  given  order  that  retain  the  dominant 
dynamics  of  a  reference,  state-feedback  controlled  system,  which  is  computationally  easy  to 
design  and  adjust.  Moreover,  it  provides  a  systematic  procedure  for  retaining  more  reference 
dynamics  by  gradually  increasing  the  controller  order  and  the  number  of  free  design  parame¬ 
ters.  The  FH  norm  provides  a  physically  meaningful  and  computationally  attractive  criterion 
for  optimal  and  suboptimal  controller  design.  In  particular,  the  possibility  of  transforming 
the  parametrized  class  of  projective  controllers  to  a  form  linear  in  the  free  parameters  has 
enabled  the  efficient  application  of  FH-norm  optimization  to  the  optimization  of  the  free 
design  parameters  in  the  parametrized  class  of  projective  controllers. 

The  described  methodology  for  designing  full  order  output  feedback  controllers  with  a 
guaranteed  H0 0  norm  bound  highlight  the  possiblity  of  achieving  additional  important  design 
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goals  with  controllers  of  the  same  order  as  the  plant.  Considered  here  in  detail  is  the  problem 
of  designing  reliable  controllers,  and  design  equations  have  been  developed  which  achieve 
reliability  at  the  expense  of  an  increase  in  the  guaranteed  bound  on  the  //oo-norm  for  both 

* 

the  base  configuration  and  when  certain  outages  of  sensors  or  actuators  occur.  Results  on  the 
*  parametrization  of  classes  of  output  feedback  controllers  that  achieve  an  /foo-norm  bound  we 

feel  will  allow  a  further  and  systematic  development  and  evaluation  of  multiatribute  designs. 
Finally,  the  DARE  to  GARE  transformation  and  the  resuilts  already  obtained  concering  the 
deeign  equations  for  full  order  based  output  feedback  control  and  the  convexity  properties 
of  the  discrete  Riccati  operator  will,  we  expect,  allow  the  results  and  insight  gained  from  the 
analysis  of  the  continuous  control  problems  to  be  carried  over  to  discrete  control  problem. 
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